Jul 09 02:55:36 devstack cinder-volume[76018]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 02:55:36 devstack cinder-volume[76018]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 02:55:36 devstack cinder-volume[76018]: we strongly recommend against using it for new projects. Jul 09 02:55:36 devstack cinder-volume[76018]: If you are already using Eventlet, we recommend migrating to a different Jul 09 02:55:36 devstack cinder-volume[76018]: framework. For more detail see Jul 09 02:55:36 devstack cinder-volume[76018]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 02:55:36 devstack cinder-volume[76018]: import eventlet # noqa Jul 09 02:55:39 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 02:55:39 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 02:55:39 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 02:55:40 devstack cinder-volume[76018]: INFO dbcounter [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Registered counter for database cinder Jul 09 02:55:40 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:55:40 devstack cinder-volume[76018]: DEBUG dbcounter [-] [76018] Writer thread running {{(pid=76018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 02:55:40 devstack cinder-volume[76018]: INFO cinder.rpc [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 02:55:40 devstack cinder-volume[76018]: INFO cinder.rpc [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 02:55:40 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:55:40 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Determined volume DB was empty at startup. Jul 09 02:55:40 devstack cinder-volume[76018]: DEBUG cinder.volume.manager [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76018) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 02:55:40 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 02:55:40 devstack cinder-volume[76018]: WARNING stevedore.named [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 02:55:40 devstack cinder-volume[76018]: WARNING castellan.key_manager [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 02:55:40 devstack cinder-volume[76018]: WARNING cinder.keymgr.conf_key_mgr [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 02:55:40 devstack cinder-volume[76018]: DEBUG cinder.volume.drivers.lvm [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76018) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 09 02:55:40 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] CMD "cinder-rtstool verify" returned: 0 in 0.483s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:55:41 devstack cinder-volume[76018]: INFO cinder.rpc [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 09 02:55:41 devstack cinder-volume[76018]: INFO cinder.rpc [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 09 02:55:41 devstack cinder-volume[76018]: WARNING stevedore.named [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 02:55:41 devstack cinder-volume[76018]: WARNING castellan.key_manager [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 02:55:41 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:55:41 devstack cinder-volume[76018]: INFO oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Starting 1 workers Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Started child 76184 {{(pid=76018) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Full set of CONF: {{(pid=76018) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] ******************************************************************************** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Configuration options gathered from: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] ================================================================================ {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] allow_availability_zone_fallback = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] allow_compression_on_image_upload = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] allowed_direct_url_schemes = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] api_rate_limit = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] auth_strategy = keystone {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] az_cache_duration = 3600 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_host = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_stats_polling_interval = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backup_api_class = cinder.backup.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76184]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backup_name_template = backup-%s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backup_use_same_host = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backup_use_temp_snapshot = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] chap_password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] chap_username = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cinder_internal_tenant_project_id = 3368874d9d434240a77af4e0622cb852 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cinder_internal_tenant_user_id = 38cb1bb7333646cda2aa70c388de74a3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cloned_volume_same_az = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cluster = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] compression_format = gzip {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] compute_api_class = cinder.compute.nova.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] config_dir = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] config_source = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] control_exchange = openstack {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] debug = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] default_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] default_group_type = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] default_volume_type = lvmdriver-1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] disk_geometry = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] driver_client_cert = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] driver_client_cert_key = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] driver_data_namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] driver_ssl_cert_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] driver_ssl_cert_verify = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] driver_use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] enable_force_upload = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] enable_new_services = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] enable_unsupported_driver = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] enforce_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] filter_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance_api_insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance_api_ssl_compression = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance_ca_certificates_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance_catalog_info = image:glance:publicURL {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance_certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance_keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance_num_retries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance_request_timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] goodness_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] graceful_shutdown_timeout = 5 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] group_api_class = cinder.group.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] host = devstack {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] image_compress_on_upload = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] image_conversion_address_space_limit = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] image_conversion_cpu_limit = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] image_conversion_disable = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] image_upload_use_cinder_backend = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] image_upload_use_internal_tenant = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] image_volume_cache_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] image_volume_cache_max_count = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] image_volume_cache_max_size_gb = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] init_host_max_objects_retrieval = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] instance_format = [instance: %(uuid)s] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] iscsi_target_flags = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] iscsi_write_cache = on {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] iser_helper = tgtadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] iser_ip_address = 192.168.122.153 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] iser_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] log_color = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] log_config_append = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] log_dir = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] log_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] log_options = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] log_rotate_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] log_rotate_interval_type = days {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] log_rotation_type = none {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] max_age = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] max_logfile_count = 30 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] max_logfile_size_mb = 200 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] max_over_subscription_ratio = 20.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] message_reap_interval = 86400 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] message_ttl = 2592000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] migration_create_volume_timeout_secs = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] monkey_patch = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] monkey_patch_modules = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] my_ip = 192.168.122.153 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] no_snapshot_gb_quota = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] num_iser_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] num_shell_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] num_volume_device_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] nvmeof_conn_info_version = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] nvmet_ns_id = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] nvmet_port_id = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] osapi_max_limit = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] osapi_volume_ext_list = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] osapi_volume_listen_port = 8776 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] osapi_volume_use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] osapi_volume_workers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] per_volume_size_limit = -1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] periodic_fuzzy_delay = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] periodic_interval = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] public_endpoint = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] publish_errors = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] quota_backup_gigabytes = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] quota_backups = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] quota_gigabytes = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] quota_groups = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] quota_snapshots = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] quota_volumes = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] rate_limit_burst = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76184]: INFO cinder.volume.manager [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] rate_limit_except_level = CRITICAL {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] rate_limit_interval = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] reinit_driver_count = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] replication_device = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] report_discard_supported = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] report_interval = 120 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] reservation_clean_interval = 86400 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] reservation_expire = 86400 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] reserved_image_namespaces = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] reserved_percentage = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] rpc_response_timeout = 120 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] run_external_periodic_tasks = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] scst_target_driver = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] scst_target_iqn_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] service_down_time = 720 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] shell_completion = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] snapshot_name_template = snapshot-%s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] snapshot_same_host = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] state_path = /opt/stack/data/cinder {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] storage_availability_zone = nova {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] storage_protocol = iSCSI {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] syslog_log_facility = LOG_USER {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] target_helper = lioadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] target_ip_address = 192.168.122.153 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] target_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] target_protocol = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] target_secondary_ip_addresses = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] trace_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] transport_url = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] until_refresh = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] use_chap_auth = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] use_default_quota_class = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] use_journal = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] use_json = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] use_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] use_stderr = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] use_syslog = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] verify_glance_signatures = enabled {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_api_class = cinder.volume.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_backend_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_clear = zero {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_clear_ionice = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_clear_size = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_copy_bps_limit = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_dd_blocksize = 1M {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_name_template = volume-%s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_service_inithost_offload = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volume_usage_audit_period = month {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] zoning_mode = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_concurrency.disable_process_locking = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.auth_type = password {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.auth_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.cache = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.include_service_catalog = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.interface = public {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_password = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcache_username = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.region_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.service_type = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.backend = dogpile.cache.null {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.backend_argument = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.backend_expiration_time = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.config_prefix = cache.oslo {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.debug_cache_backend = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.enable_retry_client = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.enable_socket_keepalive = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.expiration_time = 600 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.hashclient_retry_attempts = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.memcache_dead_retry = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.memcache_pool_maxsize = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.memcache_sasl_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.proxies = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.redis_db = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.redis_server = localhost:6379 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.retry_attempts = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.retry_delay = 0.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.socket_keepalive_count = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.socket_keepalive_idle = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.socket_keepalive_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.socket_timeout = 1.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.tls_allowed_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.tls_cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.tls_certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.tls_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.tls_keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cache.username = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] coordination.backend_url = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.asyncio_connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.asyncio_slave_connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.backend = sqlalchemy {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.connection_debug = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.connection_parameters = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.connection_recycle_time = 3600 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.connection_trace = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.db_inc_retry_interval = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.db_max_retries = 20 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.db_max_retry_interval = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.db_retry_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.max_overflow = 50 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.max_pool_size = 5 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.max_retries = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.mysql_wsrep_sync_wait = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.pool_timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.retry_interval = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.slave_connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.sqlite_synchronous = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.synchronous_reader = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] database.use_db_reconnect = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler.connection_string = messaging:// {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler.enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler.es_doc_type = notification {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler.es_scroll_size = 10000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler.es_scroll_time = 2m {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler.filter_error_trace = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler.hmac_keys = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler.sentinel_service_name = mymaster {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler.socket_timeout = 0.1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler.trace_requests = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler.trace_sqlalchemy = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler_jaeger.process_tags = {} {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler_jaeger.service_name_prefix = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] profiler_otlp.service_name_prefix = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_policy.enforce_new_defaults = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_policy.enforce_scope = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_policy.policy_default_rule = default {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_policy.policy_file = policy.yaml {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] privsep_osbrick.group = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] privsep_osbrick.helper_command = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] privsep_osbrick.user = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cinder_sys_admin.group = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cinder_sys_admin.helper_command = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] cinder_sys_admin.user = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] service_user.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] service_user.auth_type = password {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] service_user.cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] service_user.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] service_user.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] service_user.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] service_user.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] service_user.send_service_user_token = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] service_user.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] service_user.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance.auth_type = password {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance.region_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] glance.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.backend_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.chap_password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.chap_username = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.disk_geometry = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.driver_client_cert = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.driver_client_cert_key = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.driver_data_namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.driver_use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.extra_capabilities = {} {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.filter_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.goodness_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.iscsi_target_flags = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.iscsi_write_cache = on {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.iser_helper = tgtadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.iser_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.lvm_share_target = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.lvm_type = auto {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.num_shell_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.replication_device = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.report_discard_supported = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.reserved_percentage = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.target_helper = tgtadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.target_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.target_protocol = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.trace_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.unique_fqdn_network = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.use_chap_auth = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.volume_backend_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.volume_clear = zero {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.volume_clear_ionice = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.volume_clear_size = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_reports.file_event_handler = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_reports.log_dir = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.backend_host = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.chap_password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.chap_username = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.disk_geometry = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.driver_client_cert = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.extra_capabilities = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.filter_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.goodness_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.iser_helper = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.iser_ip_address = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.iser_port = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.lvm_share_target = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.lvm_type = auto {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.num_shell_tries = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.replication_device = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.report_discard_supported = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack sudo[76189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.reserved_percentage = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.scst_target_driver = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.storage_protocol = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.target_helper = lioadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.target_ip_address = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack sudo[76189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.target_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.trace_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.use_chap_auth = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.volume_clear = zero {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.volume_clear_size = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] lvmdriver-1.volumes_dir = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_notifications.driver = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_notifications.retry = -1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] key_manager.fixed_key = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.barbican_api_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.barbican_endpoint = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.barbican_endpoint_type = public {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.barbican_region_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.number_of_retries = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.retry_delay = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.send_service_user_token = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.verify_ssl = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican.verify_ssl_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican_service_user.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican_service_user.auth_type = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican_service_user.cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican_service_user.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican_service_user.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican_service_user.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican_service_user.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican_service_user.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] barbican_service_user.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vault.approle_role_id = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vault.approle_secret_id = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vault.kv_mountpoint = secret {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vault.kv_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vault.kv_version = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vault.namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vault.root_token_id = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vault.ssl_ca_crt_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vault.timeout = 60.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vault.use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:55:41 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] ******************************************************************************** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 02:55:42 devstack sudo[76189]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:42 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.724s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:42 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:42 devstack sudo[76219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:55:42 devstack sudo[76219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:43 devstack sudo[76219]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:43 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.647s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:43 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:55:43 devstack cinder-volume[76184]: INFO cinder.brick.local_dev.lvm [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 09 02:55:43 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:43 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:43 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:43 devstack sudo[76501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:55:43 devstack sudo[76501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:43 devstack sudo[76501]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:43 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.743s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:43 devstack cinder-volume[76184]: DEBUG cinder.brick.local_dev.lvm [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76184) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 09 02:55:43 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:43 devstack sudo[76755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:55:43 devstack sudo[76755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:45 devstack sudo[76755]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:45 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.123s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:45 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:45 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:45 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:45 devstack sudo[76942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:55:45 devstack sudo[76942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:45 devstack sudo[76942]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:45 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:45 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:45 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:45 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:45 devstack sudo[76968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 09 02:55:45 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:46 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:46 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.648s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:46 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:46 devstack sudo[76972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:55:46 devstack sudo[76972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:47 devstack sudo[76972]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:47 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:47 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:47 devstack sudo[76976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:55:47 devstack sudo[76976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:48 devstack sudo[76976]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:48 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.891s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:48 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:48 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:55:48 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:48 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:48 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.847s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:48 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:48 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:55:48 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:49 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:49 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.842s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:49 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:49 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:49 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:49 devstack sudo[77003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:55:49 devstack sudo[77003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:50 devstack sudo[77003]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:50 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.738s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:50 devstack cinder-volume[76184]: INFO cinder.volume.drivers.lvm [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 09 02:55:50 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:50 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:50 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:50 devstack sudo[77010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:55:50 devstack sudo[77010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:51 devstack sudo[77010]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.858s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:51 devstack cinder-volume[76184]: DEBUG cinder.volume.drivers.lvm [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Updating volume stats {{(pid=76184) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:55:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:51 devstack sudo[77129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:55:51 devstack sudo[77129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:51 devstack cinder-volume[76018]: DEBUG dbcounter [-] [76018] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:55:51 devstack sudo[77129]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:52 devstack sudo[77133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:55:52 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:52 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:52 devstack sudo[77309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:55:52 devstack sudo[77309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:53 devstack sudo[77309]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:53 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:53 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:53 devstack sudo[77312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:55:53 devstack sudo[77312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:54 devstack sudo[77312]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:54 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:54 devstack cinder-volume[76184]: INFO cinder.volume.driver [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Driver hasn't implemented _init_vendor_properties() Jul 09 02:55:54 devstack cinder-volume[76184]: DEBUG cinder.volume.driver [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76184) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 02:55:54 devstack cinder-volume[76184]: DEBUG oslo_db.sqlalchemy.engines [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:55:54 devstack cinder-volume[76184]: DEBUG dbcounter [-] [76184] Writer thread running {{(pid=76184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 02:55:54 devstack cinder-volume[76184]: DEBUG cinder.db.api [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Building query based on filter {{(pid=76184) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 02:55:54 devstack cinder-volume[76184]: DEBUG cinder.image.image_utils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76184) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 02:55:54 devstack cinder-volume[76184]: INFO cinder.keymgr.migration [None req-bfab1b96-9620-496c-8b45-806803aed4a9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 02:55:54 devstack cinder-volume[76184]: DEBUG cinder.volume.drivers.lvm [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Updating volume stats {{(pid=76184) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:55:54 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:54 devstack sudo[77317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:55:54 devstack sudo[77317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:54 devstack sudo[77317]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:54 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:54 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:54 devstack sudo[77321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:55:54 devstack sudo[77321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:55 devstack sudo[77321]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:55 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.747s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:55 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:55 devstack sudo[77328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:55:55 devstack sudo[77328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:56 devstack sudo[77328]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:56 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:56 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:56 devstack sudo[77331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:55:56 devstack sudo[77331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:56 devstack sudo[77331]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:56 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:56 devstack cinder-volume[76184]: DEBUG cinder.manager [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Notifying Schedulers of capabilities ... {{(pid=76184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:55:56 devstack cinder-volume[76184]: INFO cinder.volume.manager [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Driver initialization completed successfully. Jul 09 02:55:56 devstack cinder-volume[76184]: INFO cinder.manager [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Initiating service 2 cleanup Jul 09 02:55:56 devstack cinder-volume[76184]: INFO cinder.manager [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Service 2 cleanup completed. Jul 09 02:55:56 devstack cinder-volume[76184]: DEBUG cinder.service [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Creating RPC server for service cinder-volume {{(pid=76184) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 02:55:56 devstack cinder-volume[76184]: DEBUG cinder.service [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76184) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 02:55:57 devstack cinder-volume[76184]: INFO cinder.volume.manager [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 09 02:55:57 devstack cinder-volume[76184]: DEBUG cinder.volume.drivers.lvm [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Updating volume stats {{(pid=76184) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:55:57 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:57 devstack sudo[77335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:55:57 devstack sudo[77335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:57 devstack sudo[77335]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:57 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:57 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:57 devstack sudo[77339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:55:57 devstack sudo[77339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:58 devstack sudo[77339]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:58 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:58 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:58 devstack sudo[77345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:55:58 devstack sudo[77345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:59 devstack sudo[77345]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:59 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.691s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:59 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:59 devstack sudo[77402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:55:59 devstack sudo[77402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:59 devstack sudo[77402]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:59 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:59 devstack cinder-volume[76184]: INFO cinder.volume.manager [None req-cd83c120-1ec9-4505-a84b-3228d279146d None None] Driver post RPC initialization completed successfully. Jul 09 02:56:09 devstack cinder-volume[76184]: DEBUG dbcounter [-] [76184] Writing DB stats cinder:SELECT=3 {{(pid=76184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:56:09 devstack cinder-volume[76184]: DEBUG dbcounter [-] [76184] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:56:50 devstack cinder-volume[76184]: DEBUG oslo_service.periodic_task [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:56:50 devstack cinder-volume[76184]: DEBUG cinder.volume.drivers.lvm [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Updating volume stats {{(pid=76184) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:56:50 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:50 devstack sudo[79021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:56:50 devstack sudo[79021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:51 devstack sudo[79021]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:51 devstack sudo[79024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:56:51 devstack sudo[79024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:52 devstack sudo[79024]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:52 devstack sudo[79027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:56:52 devstack sudo[79027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:52 devstack sudo[79027]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:52 devstack sudo[79096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:56:52 devstack sudo[79096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:53 devstack sudo[79096]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:53 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:53 devstack cinder-volume[76184]: DEBUG cinder.manager [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Notifying Schedulers of capabilities ... {{(pid=76184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:56:53 devstack cinder-volume[76184]: DEBUG oslo_service.periodic_task [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running periodic task VolumeManager._thread_info {{(pid=76184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:56:53 devstack cinder-volume[76184]: DEBUG cinder.volume.manager [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] thread count: 6 {{(pid=76184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:56:53 devstack cinder-volume[76184]: DEBUG cinder.volume.manager [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] thread info: [<_MainThread(MainThread, started 132287055696000)>, , , , , ] {{(pid=76184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:57:50 devstack cinder-volume[76184]: DEBUG oslo_service.periodic_task [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:57:50 devstack cinder-volume[76184]: DEBUG cinder.volume.drivers.lvm [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Updating volume stats {{(pid=76184) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:57:50 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:50 devstack sudo[82290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:57:50 devstack sudo[82290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:51 devstack sudo[82290]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:51 devstack sudo[82310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:57:51 devstack sudo[82310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:52 devstack sudo[82310]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:52 devstack sudo[82329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:57:52 devstack sudo[82329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:52 devstack sudo[82329]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:52 devstack sudo[82333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:57:52 devstack sudo[82333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:53 devstack sudo[82333]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:53 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:53 devstack cinder-volume[76184]: DEBUG cinder.manager [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Notifying Schedulers of capabilities ... {{(pid=76184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:53 devstack cinder-volume[76184]: DEBUG oslo_service.periodic_task [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running periodic task VolumeManager._thread_info {{(pid=76184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:57:53 devstack cinder-volume[76184]: DEBUG cinder.volume.manager [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] thread count: 6 {{(pid=76184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:57:53 devstack cinder-volume[76184]: DEBUG cinder.volume.manager [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] thread info: [<_MainThread(MainThread, started 132287055696000)>, , , , , ] {{(pid=76184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:58:09 devstack cinder-volume[76184]: DEBUG dbcounter [-] [76184] Writing DB stats cinder:SELECT=1 {{(pid=76184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:58:09 devstack cinder-volume[76184]: DEBUG dbcounter [-] [76184] Writing DB stats cinder:UPDATE=1 {{(pid=76184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:58:50 devstack cinder-volume[76184]: DEBUG oslo_service.periodic_task [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:58:50 devstack cinder-volume[76184]: DEBUG cinder.volume.drivers.lvm [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Updating volume stats {{(pid=76184) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:58:50 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:50 devstack sudo[84144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:58:50 devstack sudo[84144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:51 devstack sudo[84144]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:51 devstack sudo[84156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:58:51 devstack sudo[84156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:52 devstack sudo[84156]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:52 devstack sudo[84179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:58:52 devstack sudo[84179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:52 devstack sudo[84179]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.666s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:52 devstack sudo[84189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:58:52 devstack sudo[84189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:53 devstack sudo[84189]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:53 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.724s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:53 devstack cinder-volume[76184]: DEBUG cinder.manager [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Notifying Schedulers of capabilities ... {{(pid=76184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:58:53 devstack cinder-volume[76184]: DEBUG oslo_service.periodic_task [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running periodic task VolumeManager._thread_info {{(pid=76184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:58:53 devstack cinder-volume[76184]: DEBUG cinder.volume.manager [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] thread count: 6 {{(pid=76184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:58:53 devstack cinder-volume[76184]: DEBUG cinder.volume.manager [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] thread info: [<_MainThread(MainThread, started 132287055696000)>, , , , , ] {{(pid=76184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:59:50 devstack cinder-volume[76184]: DEBUG oslo_service.periodic_task [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:59:50 devstack cinder-volume[76184]: DEBUG cinder.volume.drivers.lvm [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Updating volume stats {{(pid=76184) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:59:50 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:50 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:59:50 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:51 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:51 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:51 devstack sudo[85484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:59:51 devstack sudo[85484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:52 devstack sudo[85484]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:52 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:59:52 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:52 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:52 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:52 devstack sudo[85501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:59:52 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:53 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:53 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:53 devstack cinder-volume[76184]: DEBUG cinder.manager [None req-7c591b7e-1784-4be9-8db5-dba4ab5de5cc None None] Notifying Schedulers of capabilities ... {{(pid=76184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:09 devstack cinder-volume[76184]: DEBUG dbcounter [-] [76184] Writing DB stats cinder:SELECT=1 {{(pid=76184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:00:09 devstack cinder-volume[76184]: DEBUG dbcounter [-] [76184] Writing DB stats cinder:UPDATE=1 {{(pid=76184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:00:23 devstack cinder-volume[76018]: INFO oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Caught SIGTERM, stopping children Jul 09 03:00:23 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Acquiring lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 03:00:23 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Acquired lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 03:00:23 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Releasing lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 03:00:23 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Stop services. {{(pid=76018) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 03:00:23 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Killing children. {{(pid=76018) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 03:00:23 devstack cinder-volume[76018]: INFO oslo_service.backend._eventlet.service [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Waiting on 1 children to exit Jul 09 03:00:28 devstack cinder-volume[76184]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 09 03:00:29 devstack cinder-volume[86340]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 03:00:29 devstack cinder-volume[86340]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 03:00:29 devstack cinder-volume[86340]: we strongly recommend against using it for new projects. Jul 09 03:00:29 devstack cinder-volume[86340]: If you are already using Eventlet, we recommend migrating to a different Jul 09 03:00:29 devstack cinder-volume[86340]: framework. For more detail see Jul 09 03:00:29 devstack cinder-volume[86340]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 03:00:29 devstack cinder-volume[86340]: import eventlet # noqa Jul 09 03:00:31 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 03:00:31 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 03:00:31 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 03:00:31 devstack cinder-volume[86340]: INFO dbcounter [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Registered counter for database cinder Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_db.sqlalchemy.engines [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86340) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 03:00:32 devstack cinder-volume[76184]: DEBUG oslo_concurrency.lockutils [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Acquiring lock "singleton_lock" {{(pid=76184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 03:00:32 devstack cinder-volume[76184]: DEBUG oslo_concurrency.lockutils [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Acquired lock "singleton_lock" {{(pid=76184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 03:00:32 devstack cinder-volume[76184]: DEBUG oslo_concurrency.lockutils [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Releasing lock "singleton_lock" {{(pid=76184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 03:00:32 devstack cinder-volume[76184]: WARNING amqp [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 03:00:32 devstack cinder-volume[76184]: WARNING amqp [None req-de6f3c00-12aa-4c77-8b54-1c863ebc0f09 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG dbcounter [-] [86340] Writer thread running {{(pid=86340) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 03:00:32 devstack cinder-volume[86340]: INFO cinder.rpc [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 03:00:32 devstack cinder-volume[86340]: INFO cinder.rpc [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_db.sqlalchemy.engines [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86340) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 03:00:32 devstack cinder-volume[86340]: INFO cinder.volume.manager [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Determined volume DB was empty at startup. Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG cinder.volume.manager [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86340) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 03:00:32 devstack cinder-volume[86340]: INFO cinder.volume.manager [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 03:00:32 devstack cinder-volume[86340]: WARNING stevedore.named [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 03:00:32 devstack cinder-volume[86340]: WARNING castellan.key_manager [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 03:00:32 devstack cinder-volume[86340]: WARNING cinder.keymgr.conf_key_mgr [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 03:00:32 devstack cinder-volume[86340]: INFO cinder.volume.manager [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_db.sqlalchemy.engines [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86340) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 03:00:32 devstack cinder-volume[86340]: INFO oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Starting 1 workers Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Started child 86607 {{(pid=86340) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Full set of CONF: {{(pid=86340) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] ******************************************************************************** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Configuration options gathered from: {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 03:00:32 devstack cinder-volume[86607]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] ================================================================================ {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] allow_availability_zone_fallback = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] allow_compression_on_image_upload = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] allowed_direct_url_schemes = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] api_rate_limit = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] auth_strategy = keystone {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_availability_zone = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_host = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_stats_polling_interval = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backup_api_class = cinder.backup.api.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backup_name_template = backup-%s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backup_use_same_host = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backup_use_temp_snapshot = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] chap_password = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] chap_username = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cinder_internal_tenant_project_id = 3368874d9d434240a77af4e0622cb852 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cinder_internal_tenant_user_id = 38cb1bb7333646cda2aa70c388de74a3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cluster = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] compression_format = gzip {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] compute_api_class = cinder.compute.nova.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] config_dir = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] config_source = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] control_exchange = openstack {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] debug = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] default_availability_zone = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] default_group_type = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] default_volume_type = QuobyteHD {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] disk_geometry = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] driver_client_cert = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] driver_client_cert_key = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] driver_data_namespace = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] driver_ssl_cert_path = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] driver_ssl_cert_verify = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] driver_use_ssl = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] enable_new_services = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] enable_unsupported_driver = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] enabled_backends = ['QuobyteHD'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] enforce_multipath_for_image_xfer = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] filter_function = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance_api_insecure = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance_api_ssl_compression = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance_ca_certificates_file = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance_catalog_info = image:glance:publicURL {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance_certfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance_keyfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance_num_retries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance_request_timeout = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] goodness_function = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] graceful_shutdown_timeout = 5 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86607]: INFO cinder.volume.manager [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] group_api_class = cinder.group.api.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] host = devstack {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] image_compress_on_upload = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86607]: DEBUG cinder.volume.drivers.remotefs [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86607) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] image_conversion_address_space_limit = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] image_conversion_cpu_limit = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] image_conversion_disable = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] image_upload_use_cinder_backend = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] image_upload_use_internal_tenant = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] image_volume_cache_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] image_volume_cache_max_count = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] image_volume_cache_max_size_gb = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] init_host_max_objects_retrieval = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] instance_format = [instance: %(uuid)s] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] iscsi_target_flags = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] iscsi_write_cache = on {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] iser_helper = tgtadm {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] iser_ip_address = 192.168.122.153 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] iser_port = 3260 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] log_color = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] log_config_append = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] log_dir = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] log_file = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] log_options = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] log_rotate_interval = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] log_rotate_interval_type = days {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] log_rotation_type = none {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] max_age = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] max_logfile_count = 30 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] max_logfile_size_mb = 200 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] max_over_subscription_ratio = 20.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] message_reap_interval = 86400 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] message_ttl = 2592000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] migration_create_volume_timeout_secs = 300 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] monkey_patch = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] monkey_patch_modules = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] my_ip = 192.168.122.153 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] no_snapshot_gb_quota = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] num_iser_scan_tries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] num_shell_tries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] num_volume_device_scan_tries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] nvmeof_conn_info_version = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] nvmet_ns_id = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] nvmet_port_id = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] osapi_max_limit = 1000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] osapi_volume_ext_list = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] osapi_volume_listen_port = 8776 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] osapi_volume_use_ssl = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] osapi_volume_workers = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] per_volume_size_limit = -1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] periodic_fuzzy_delay = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] periodic_interval = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] public_endpoint = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] publish_errors = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] quota_backup_gigabytes = 1000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] quota_backups = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] quota_gigabytes = 1000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] quota_groups = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] quota_snapshots = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] quota_volumes = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] rate_limit_burst = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] rate_limit_except_level = CRITICAL {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] rate_limit_interval = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] reinit_driver_count = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] replication_device = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] report_discard_supported = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] report_interval = 120 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] reservation_clean_interval = 86400 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] reservation_expire = 86400 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] reserved_image_namespaces = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] reserved_percentage = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] rpc_response_timeout = 120 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] run_external_periodic_tasks = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] scst_target_driver = iscsi {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] scst_target_iqn_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] service_down_time = 720 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] shell_completion = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] snapshot_name_template = snapshot-%s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] split_loggers = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] state_path = /opt/stack/data/cinder {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] storage_availability_zone = nova {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] storage_protocol = iSCSI {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] syslog_log_facility = LOG_USER {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] target_helper = lioadm {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] target_ip_address = 192.168.122.153 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] target_port = 3260 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] target_protocol = iscsi {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] target_secondary_ip_addresses = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] trace_flags = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] transport_url = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] until_refresh = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] use_chap_auth = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] use_default_quota_class = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] use_journal = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] use_json = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] use_multipath_for_image_xfer = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] use_stderr = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] use_syslog = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] verify_glance_signatures = enabled {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_api_class = cinder.volume.api.API {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_backend_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_clear = zero {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_clear_ionice = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_clear_size = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_copy_bps_limit = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_dd_blocksize = 1M {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_name_template = volume-%s {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_service_inithost_offload = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volume_usage_audit_period = month {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] zoning_mode = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_concurrency.disable_process_locking = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.auth_section = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.auth_type = password {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.auth_version = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.cache = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.certfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.include_service_catalog = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.insecure = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.interface = public {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.keyfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_password = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcache_username = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.region_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.service_type = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.backend = dogpile.cache.null {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.backend_argument = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.backend_expiration_time = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:32 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.config_prefix = cache.oslo {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.debug_cache_backend = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.enable_retry_client = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.enable_socket_keepalive = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.expiration_time = 600 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.hashclient_retry_attempts = 2 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.memcache_dead_retry = 300 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.memcache_pool_maxsize = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.memcache_sasl_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.password = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.proxies = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.redis_db = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.redis_server = localhost:6379 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.retry_attempts = 2 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.retry_delay = 0.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.socket_keepalive_count = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.socket_keepalive_idle = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.socket_keepalive_interval = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.socket_timeout = 1.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86607]: DEBUG cinder.volume.drivers.quobyte [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86607) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 03:00:33 devstack cinder-volume[86607]: WARNING cinder.volume.drivers.quobyte [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 03:00:33 devstack cinder-volume[86607]: WARNING cinder.volume.drivers.quobyte [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.tls_allowed_ciphers = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.tls_cafile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.tls_certfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Running cmd (subprocess): mount.quobyte {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.tls_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.tls_keyfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cache.username = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] coordination.backend_url = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.asyncio_connection = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.asyncio_slave_connection = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.backend = sqlalchemy {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.connection = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.connection_debug = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.connection_parameters = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.connection_recycle_time = 3600 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.connection_trace = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.db_inc_retry_interval = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.db_max_retries = 20 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.db_max_retry_interval = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.db_retry_interval = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.max_overflow = 50 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.max_pool_size = 5 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.max_retries = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.mysql_wsrep_sync_wait = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.pool_timeout = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.retry_interval = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.slave_connection = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.sqlite_synchronous = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.synchronous_reader = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] database.use_db_reconnect = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler.connection_string = messaging:// {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler.enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler.es_doc_type = notification {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler.es_scroll_size = 10000 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler.es_scroll_time = 2m {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler.filter_error_trace = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler.hmac_keys = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler.sentinel_service_name = mymaster {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler.socket_timeout = 0.1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler.trace_requests = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler.trace_sqlalchemy = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler_jaeger.process_tags = {} {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler_jaeger.service_name_prefix = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] profiler_otlp.service_name_prefix = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_policy.enforce_new_defaults = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_policy.enforce_scope = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_policy.policy_default_rule = default {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_policy.policy_file = policy.yaml {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] privsep_osbrick.group = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] privsep_osbrick.helper_command = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] privsep_osbrick.user = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cinder_sys_admin.group = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cinder_sys_admin.helper_command = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] cinder_sys_admin.user = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] service_user.auth_section = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] service_user.auth_type = password {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] service_user.cafile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] service_user.certfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] service_user.collect_timing = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] service_user.insecure = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] service_user.keyfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] service_user.send_service_user_token = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] service_user.split_loggers = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] service_user.timeout = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance.auth_section = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance.auth_type = password {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance.certfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance.collect_timing = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance.insecure = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance.keyfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance.region_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance.split_loggers = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] glance.timeout = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.backend_availability_zone = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.chap_password = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.chap_username = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.disk_geometry = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.driver_client_cert = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.driver_client_cert_key = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.driver_data_namespace = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.driver_use_ssl = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.extra_capabilities = {} {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.filter_function = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.goodness_function = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.iscsi_target_flags = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.iscsi_write_cache = on {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.iser_helper = tgtadm {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.iser_port = 3260 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nas_host = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nas_login = admin {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nas_mount_options = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nas_password = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nas_private_key = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nas_share_path = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack quobyte-client[86619]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 03:00:33 devstack quobyte-client[86619]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.num_shell_tries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:33 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:33 devstack cinder-volume[86607]: DEBUG cinder.volume.drivers.quobyte [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=86607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86607]: INFO cinder.volume.drivers.quobyte [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b ... Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 -c /etc/quobyte/client-cinder.cfg {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.quobyte_volume_url = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.replication_device = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.report_discard_supported = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.reserved_percentage = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.target_helper = tgtadm {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.target_port = 3260 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.target_protocol = iscsi {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.trace_flags = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.unique_fqdn_network = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.use_chap_auth = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.volume_backend_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.volume_clear = zero {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.volume_clear_ionice = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.volume_clear_size = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_reports.file_event_handler = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack sudo[86620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 -c /etc/quobyte/client-cinder.cfg Jul 09 03:00:33 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_reports.log_dir = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.backend_availability_zone = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.backend_host = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.chap_password = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.chap_username = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.chiscsi_conf = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.disk_geometry = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.driver_client_cert = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.driver_data_namespace = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.driver_use_ssl = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.extra_capabilities = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.filter_function = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.goodness_function = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.iser_helper = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.iser_ip_address = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.iser_port = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.iser_target_prefix = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nas_host = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nas_login = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nas_mount_options = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nas_password = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nas_private_key = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nas_share_path = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nas_ssh_port = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.num_shell_tries = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.nvmet_port_id = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.replication_device = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.report_discard_supported = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.reserved_percentage = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.scst_target_driver = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.storage_protocol = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.target_helper = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.target_ip_address = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.target_port = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.target_prefix = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.target_protocol = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.trace_flags = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.use_chap_auth = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.volume_clear = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.volume_clear_size = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] QuobyteHD.volumes_dir = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.ssl = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_notifications.driver = [] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_notifications.retry = -1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] key_manager.fixed_key = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.barbican_api_version = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.barbican_endpoint = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.barbican_endpoint_type = public {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.barbican_region_name = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.cafile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.certfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.collect_timing = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.insecure = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.keyfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.number_of_retries = 60 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.retry_delay = 1 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.send_service_user_token = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.split_loggers = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.timeout = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.verify_ssl = True {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican.verify_ssl_path = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican_service_user.auth_section = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican_service_user.auth_type = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican_service_user.cafile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican_service_user.certfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican_service_user.collect_timing = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican_service_user.insecure = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican_service_user.keyfile = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican_service_user.split_loggers = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] barbican_service_user.timeout = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vault.approle_role_id = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vault.approle_secret_id = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vault.kv_mountpoint = secret {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vault.kv_path = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vault.kv_version = 2 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vault.namespace = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vault.root_token_id = **** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vault.ssl_ca_crt_file = None {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vault.timeout = 60.0 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vault.use_ssl = False {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:33 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] ******************************************************************************** {{(pid=86340) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 03:00:33 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:33 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.843s {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:33 devstack cinder-volume[86607]: INFO cinder.volume.drivers.quobyte [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b succeeded Jul 09 03:00:33 devstack cinder-volume[86607]: DEBUG cinder.volume.drivers.quobyte [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=86607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:33 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.860s {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:33 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:33 devstack sudo[86705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:00:34 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:34 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.598s {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:34 devstack cinder-volume[86607]: INFO cinder.volume.driver [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG cinder.volume.driver [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.650203704834, 'free_capacity_gb': 1775.650203704834, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86607) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG oslo_db.sqlalchemy.engines [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86607) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG dbcounter [-] [86607] Writer thread running {{(pid=86607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG cinder.db.api [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Building query based on filter {{(pid=86607) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG cinder.image.image_utils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86607) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 03:00:34 devstack cinder-volume[86607]: INFO cinder.keymgr.migration [None req-f28d8cc6-6213-4354-af01-8a6f8e1b1842 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG cinder.volume.drivers.quobyte [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=86607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG cinder.volume.drivers.quobyte [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=86607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:34 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:34 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:00:34 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:35 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:35 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.615s {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:35 devstack cinder-volume[86607]: DEBUG cinder.manager [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Notifying Schedulers of capabilities ... {{(pid=86607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:35 devstack cinder-volume[86607]: INFO cinder.volume.manager [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Driver initialization completed successfully. Jul 09 03:00:35 devstack cinder-volume[86607]: INFO cinder.manager [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Initiating service 3 cleanup Jul 09 03:00:35 devstack cinder-volume[86607]: INFO cinder.manager [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Service 3 cleanup completed. Jul 09 03:00:35 devstack cinder-volume[86607]: DEBUG cinder.service [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Creating RPC server for service cinder-volume {{(pid=86607) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 03:00:35 devstack cinder-volume[86607]: DEBUG cinder.service [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86607) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 03:00:35 devstack cinder-volume[86607]: INFO cinder.volume.manager [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 03:00:35 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:35 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:35 devstack cinder-volume[86607]: DEBUG cinder.volume.drivers.quobyte [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=86607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:35 devstack cinder-volume[86607]: DEBUG cinder.volume.drivers.quobyte [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=86607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:35 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:35 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:35 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:00:35 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:36 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:36 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.802s {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:36 devstack cinder-volume[86607]: INFO cinder.volume.manager [None req-fd717a62-cc0d-42d2-b01e-4e4d3f877452 None None] Driver post RPC initialization completed successfully. Jul 09 03:00:40 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-17d9fd05-42c5-48cb-9664-8d797b754e21 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:40 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-17d9fd05-42c5-48cb-9664-8d797b754e21 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:40 devstack cinder-volume[86607]: DEBUG cinder.volume.drivers.quobyte [None req-17d9fd05-42c5-48cb-9664-8d797b754e21 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=86607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:40 devstack cinder-volume[86607]: DEBUG cinder.volume.drivers.quobyte [None req-17d9fd05-42c5-48cb-9664-8d797b754e21 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=86607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:40 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-17d9fd05-42c5-48cb-9664-8d797b754e21 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:40 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-17d9fd05-42c5-48cb-9664-8d797b754e21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:40 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:00:40 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:40 devstack cinder-volume[86340]: INFO oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Caught SIGTERM, stopping children Jul 09 03:00:40 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Acquiring lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 03:00:40 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Acquired lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 03:00:40 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Releasing lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 03:00:40 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Stop services. {{(pid=86340) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 03:00:40 devstack cinder-volume[86340]: DEBUG oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Killing children. {{(pid=86340) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 03:00:40 devstack cinder-volume[86340]: INFO oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Waiting on 1 children to exit Jul 09 03:00:41 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:41 devstack cinder-volume[86607]: DEBUG oslo_concurrency.processutils [None req-17d9fd05-42c5-48cb-9664-8d797b754e21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.831s {{(pid=86607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:41 devstack cinder-volume[86607]: DEBUG cinder.manager [None req-17d9fd05-42c5-48cb-9664-8d797b754e21 None None] Notifying Schedulers of capabilities ... {{(pid=86607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo.messaging._drivers.impl_rabbit [None req-17d9fd05-42c5-48cb-9664-8d797b754e21 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo.messaging._drivers.impl_rabbit [None req-17d9fd05-42c5-48cb-9664-8d797b754e21 None None] Unable to connect to AMQP server on 192.168.122.153:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server [None req-17d9fd05-42c5-48cb-9664-8d797b754e21 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.153:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1139, in ensure Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1128, in execute_method Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server method() Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1590, in _publish Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server self._producer.publish( Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server return _publish( Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server listener(*args) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server raise error_for_code( Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1709, in fanout_send Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1539, in _ensure_publishing Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1161, in ensure Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.153:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 09 03:00:41 devstack cinder-volume[86607]: ERROR oslo_messaging.rpc.server Jul 09 03:00:43 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Acquiring lock "singleton_lock" {{(pid=86607) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 03:00:43 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Acquired lock "singleton_lock" {{(pid=86607) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 03:00:43 devstack cinder-volume[86607]: DEBUG oslo_concurrency.lockutils [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Releasing lock "singleton_lock" {{(pid=86607) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 03:00:43 devstack cinder-volume[86607]: WARNING amqp [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 03:00:43 devstack cinder-volume[86607]: WARNING amqp [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 03:00:43 devstack cinder-volume[86340]: INFO oslo_service.backend._eventlet.service [None req-5568557e-bdd2-4529-b32e-bdd5ac649934 None None] Child 86607 exited with status 0 Jul 09 03:00:44 devstack cinder-volume[87024]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 03:00:44 devstack cinder-volume[87024]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 03:00:44 devstack cinder-volume[87024]: we strongly recommend against using it for new projects. Jul 09 03:00:44 devstack cinder-volume[87024]: If you are already using Eventlet, we recommend migrating to a different Jul 09 03:00:44 devstack cinder-volume[87024]: framework. For more detail see Jul 09 03:00:44 devstack cinder-volume[87024]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 03:00:44 devstack cinder-volume[87024]: import eventlet # noqa Jul 09 03:00:47 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87024) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 03:00:47 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87024) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 03:00:47 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87024) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 03:00:47 devstack cinder-volume[87024]: INFO dbcounter [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Registered counter for database cinder Jul 09 03:00:47 devstack cinder-volume[87024]: DEBUG oslo_db.sqlalchemy.engines [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87024) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG dbcounter [-] [87024] Writer thread running {{(pid=87024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 03:00:48 devstack cinder-volume[87024]: INFO cinder.rpc [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 03:00:48 devstack cinder-volume[87024]: INFO cinder.rpc [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_db.sqlalchemy.engines [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87024) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 03:00:48 devstack cinder-volume[87024]: INFO cinder.volume.manager [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Determined volume DB was empty at startup. Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG cinder.volume.manager [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87024) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 03:00:48 devstack cinder-volume[87024]: WARNING stevedore.named [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 03:00:48 devstack cinder-volume[87024]: WARNING castellan.key_manager [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 03:00:48 devstack cinder-volume[87024]: WARNING cinder.keymgr.conf_key_mgr [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 03:00:48 devstack cinder-volume[87024]: INFO cinder.volume.manager [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_db.sqlalchemy.engines [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87024) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 03:00:48 devstack cinder-volume[87024]: INFO oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Starting 1 workers Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Started child 87216 {{(pid=87024) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Full set of CONF: {{(pid=87024) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] ******************************************************************************** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] Configuration options gathered from: {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] ================================================================================ {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 03:00:48 devstack cinder-volume[87216]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] allow_availability_zone_fallback = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] allow_compression_on_image_upload = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] allowed_direct_url_schemes = [] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] api_rate_limit = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] auth_strategy = keystone {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_availability_zone = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_host = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_name = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_stats_polling_interval = 60 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backup_api_class = cinder.backup.api.API {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backup_name_template = backup-%s {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backup_use_same_host = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backup_use_temp_snapshot = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] chap_password = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] chap_username = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cinder_internal_tenant_project_id = 3368874d9d434240a77af4e0622cb852 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cinder_internal_tenant_user_id = 38cb1bb7333646cda2aa70c388de74a3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cluster = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] compression_format = gzip {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] compute_api_class = cinder.compute.nova.API {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] config_dir = [] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] config_source = [] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] control_exchange = openstack {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] debug = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] default_availability_zone = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] default_group_type = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] default_volume_type = QuobyteHD {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] disk_geometry = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] driver_client_cert = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] driver_client_cert_key = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] driver_data_namespace = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] driver_ssl_cert_path = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] driver_ssl_cert_verify = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] driver_use_ssl = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] enable_new_services = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] enable_unsupported_driver = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] enabled_backends = ['QuobyteHD'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] enforce_multipath_for_image_xfer = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] filter_function = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance_api_insecure = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance_api_ssl_compression = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance_ca_certificates_file = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance_catalog_info = image:glance:publicURL {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance_certfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance_keyfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance_num_retries = 3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance_request_timeout = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] goodness_function = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] graceful_shutdown_timeout = 5 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] group_api_class = cinder.group.api.API {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] host = devstack {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] image_compress_on_upload = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] image_conversion_address_space_limit = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] image_conversion_cpu_limit = 60 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] image_conversion_disable = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] image_upload_use_cinder_backend = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] image_upload_use_internal_tenant = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] image_volume_cache_enabled = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] image_volume_cache_max_count = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] image_volume_cache_max_size_gb = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] init_host_max_objects_retrieval = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] instance_format = [instance: %(uuid)s] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] iscsi_target_flags = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] iscsi_write_cache = on {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] iser_helper = tgtadm {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] iser_ip_address = 192.168.122.153 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] iser_port = 3260 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] log_color = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] log_config_append = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87216) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] log_dir = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] log_file = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] log_options = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] log_rotate_interval = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] log_rotate_interval_type = days {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] log_rotation_type = none {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] max_age = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] max_logfile_count = 30 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] max_logfile_size_mb = 200 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] max_over_subscription_ratio = 20.0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] message_reap_interval = 86400 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] message_ttl = 2592000 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] migration_create_volume_timeout_secs = 300 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] monkey_patch = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] monkey_patch_modules = [] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] my_ip = 192.168.122.153 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] no_snapshot_gb_quota = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] num_iser_scan_tries = 3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] num_shell_tries = 3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] num_volume_device_scan_tries = 3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] nvmeof_conn_info_version = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] nvmet_ns_id = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] nvmet_port_id = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] osapi_max_limit = 1000 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] osapi_volume_ext_list = [] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] osapi_volume_listen = 0.0.0.0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] osapi_volume_listen_port = 8776 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] osapi_volume_use_ssl = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] osapi_volume_workers = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] per_volume_size_limit = -1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] periodic_fuzzy_delay = 60 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] periodic_interval = 60 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] project_id_regex = [0-9a-f\-]+ {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] public_endpoint = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] publish_errors = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] quota_backup_gigabytes = 1000 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] quota_backups = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] quota_gigabytes = 1000 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] quota_groups = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] quota_snapshots = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] quota_volumes = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] rate_limit_burst = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] rate_limit_except_level = CRITICAL {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] rate_limit_interval = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] reinit_driver_count = 3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] replication_device = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] report_discard_supported = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] report_interval = 120 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] reservation_clean_interval = 86400 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] reservation_expire = 86400 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] reserved_image_namespaces = [] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] reserved_percentage = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] rpc_response_timeout = 120 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] run_external_periodic_tasks = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] scst_target_driver = iscsi {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] scst_target_iqn_name = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] service_down_time = 720 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] shell_completion = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] snapshot_name_template = snapshot-%s {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] split_loggers = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] state_path = /opt/stack/data/cinder {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] storage_availability_zone = nova {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] storage_protocol = iSCSI {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] syslog_log_facility = LOG_USER {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] target_helper = lioadm {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] target_ip_address = 192.168.122.153 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] target_port = 3260 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] target_protocol = iscsi {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] target_secondary_ip_addresses = [] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] trace_flags = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] transfer_api_class = cinder.transfer.api.API {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] transport_url = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] until_refresh = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] use_chap_auth = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] use_default_quota_class = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] use_journal = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] use_json = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] use_multipath_for_image_xfer = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] use_stderr = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] use_syslog = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] verify_glance_signatures = enabled {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_api_class = cinder.volume.api.API {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_backend_name = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_clear = zero {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_clear_ionice = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_clear_size = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_copy_bps_limit = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_dd_blocksize = 1M {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_name_template = volume-%s {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_service_inithost_offload = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volume_usage_audit_period = month {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] zoning_mode = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_concurrency.disable_process_locking = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.auth_section = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.auth_type = password {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.auth_version = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.cache = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.certfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.delay_auth_decision = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.http_connect_timeout = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.include_service_catalog = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.insecure = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.interface = public {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.keyfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_password = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcache_username = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.region_name = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.service_token_roles_required = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.service_type = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.token_cache_time = 300 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.backend = dogpile.cache.null {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.backend_argument = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.backend_expiration_time = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.config_prefix = cache.oslo {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.debug_cache_backend = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.enable_retry_client = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.enable_socket_keepalive = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87216) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.enabled = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.expiration_time = 600 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.hashclient_retry_attempts = 2 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.quobyte [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.quobyte [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.memcache_dead_retry = 300 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.memcache_pool_maxsize = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Running cmd (subprocess): mount.quobyte {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.memcache_sasl_enabled = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.password = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.proxies = [] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.redis_db = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.redis_sentinel_service_name = mymaster {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.redis_server = localhost:6379 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.retry_attempts = 2 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.retry_delay = 0.0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.socket_keepalive_count = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.socket_keepalive_idle = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.socket_keepalive_interval = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.socket_timeout = 1.0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.tls_allowed_ciphers = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.tls_cafile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.tls_certfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.tls_enabled = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.tls_keyfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cache.username = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] coordination.backend_url = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.asyncio_connection = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.asyncio_slave_connection = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.backend = sqlalchemy {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.connection = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.connection_debug = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.connection_parameters = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.connection_recycle_time = 3600 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.connection_trace = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.db_inc_retry_interval = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.db_max_retries = 20 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.db_max_retry_interval = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.db_retry_interval = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.max_overflow = 50 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.max_pool_size = 5 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.max_retries = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.mysql_wsrep_sync_wait = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.pool_timeout = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.retry_interval = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.slave_connection = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.sqlite_synchronous = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.synchronous_reader = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] database.use_db_reconnect = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler.connection_string = messaging:// {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler.enabled = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler.es_doc_type = notification {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler.es_scroll_size = 10000 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler.es_scroll_time = 2m {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler.filter_error_trace = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler.hmac_keys = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler.sentinel_service_name = mymaster {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler.socket_timeout = 0.1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler.trace_requests = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler.trace_sqlalchemy = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler_jaeger.process_tags = {} {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler_jaeger.service_name_prefix = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] profiler_otlp.service_name_prefix = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_policy.enforce_new_defaults = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_policy.enforce_scope = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_policy.policy_default_rule = default {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_policy.policy_file = policy.yaml {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_policy.remote_timeout = 60.0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] privsep_osbrick.group = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] privsep_osbrick.helper_command = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] privsep_osbrick.user = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cinder_sys_admin.group = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cinder_sys_admin.helper_command = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] cinder_sys_admin.user = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] service_user.auth_section = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] service_user.auth_type = password {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] service_user.cafile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] service_user.certfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] service_user.collect_timing = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] service_user.insecure = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] service_user.keyfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] service_user.send_service_user_token = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] service_user.split_loggers = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] service_user.timeout = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance.auth_section = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance.auth_type = password {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance.certfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance.collect_timing = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance.insecure = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance.keyfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance.region_name = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance.split_loggers = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] glance.timeout = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.backend_availability_zone = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.chap_password = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.chap_username = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.disk_geometry = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.driver_client_cert = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.driver_client_cert_key = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.driver_data_namespace = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.driver_use_ssl = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.enable_unsupported_driver = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.extra_capabilities = {} {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.filter_function = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.goodness_function = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.iscsi_target_flags = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.iscsi_write_cache = on {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.iser_helper = tgtadm {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.iser_port = 3260 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nas_host = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nas_login = admin {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nas_mount_options = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nas_password = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nas_private_key = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nas_share_path = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nas_ssh_port = 22 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.num_shell_tries = 3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.nvmet_port_id = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.quobyte_client_cfg = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack quobyte-client[87233]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.quobyte_volume_url = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.replication_device = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.report_discard_supported = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.reserved_percentage = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.scst_target_driver = iscsi {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.scst_target_iqn_name = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack quobyte-client[87233]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.storage_protocol = iSCSI {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.target_helper = tgtadm {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.target_port = 3260 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.target_protocol = iscsi {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.trace_flags = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.unique_fqdn_network = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.use_chap_auth = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.volume_backend_name = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.volume_clear = zero {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.volume_clear_ionice = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.volume_clear_size = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_reports.file_event_handler = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_reports.log_dir = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.backend_availability_zone = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.backend_host = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.chap_password = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.chap_username = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.chiscsi_conf = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.disk_geometry = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.driver_client_cert = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.driver_client_cert_key = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.driver_data_namespace = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.driver_use_ssl = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.extra_capabilities = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.filter_function = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.goodness_function = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.iscsi_target_flags = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.iscsi_write_cache = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.iser_helper = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.iser_ip_address = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.iser_port = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.iser_target_prefix = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nas_host = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nas_login = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nas_mount_options = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nas_password = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nas_private_key = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nas_share_path = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nas_ssh_port = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.num_shell_tries = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nvmet_ns_id = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.nvmet_port_id = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.replication_device = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.report_discard_supported = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.reserved_percentage = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.scst_target_driver = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.storage_protocol = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.target_helper = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.target_ip_address = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.target_port = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.target_prefix = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.target_protocol = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.trace_flags = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.unique_fqdn_network = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.use_chap_auth = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.volume_clear = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.volume_clear_ionice = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.volume_clear_size = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] QuobyteHD.volumes_dir = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.ssl = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.ssl_version = {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_notifications.driver = [] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_notifications.retry = -1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] oslo_messaging_notifications.transport_url = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] key_manager.fixed_key = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.barbican_api_version = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.barbican_endpoint = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.barbican_endpoint_type = public {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.barbican_region_name = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.cafile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.certfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.collect_timing = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.insecure = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.keyfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.number_of_retries = 60 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.retry_delay = 1 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.send_service_user_token = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.split_loggers = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.timeout = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.verify_ssl = True {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican.verify_ssl_path = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican_service_user.auth_section = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican_service_user.auth_type = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican_service_user.cafile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican_service_user.certfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican_service_user.collect_timing = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican_service_user.insecure = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican_service_user.keyfile = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican_service_user.split_loggers = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] barbican_service_user.timeout = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vault.approle_role_id = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vault.approle_secret_id = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vault.kv_mountpoint = secret {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vault.kv_path = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vault.kv_version = 2 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vault.namespace = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vault.root_token_id = **** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vault.ssl_ca_crt_file = None {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vault.timeout = 60.0 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vault.use_ssl = False {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 03:00:48 devstack cinder-volume[87024]: DEBUG oslo_service.backend._eventlet.service [None req-c84fb8fd-d188-41fb-8685-3d593ec4b44b None None] ******************************************************************************** {{(pid=87024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 03:00:49 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.623s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:49 devstack cinder-volume[87216]: INFO cinder.volume.driver [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Driver hasn't implemented _init_vendor_properties() Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG cinder.volume.driver [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6497993469238, 'free_capacity_gb': 1775.6497993469238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87216) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG oslo_db.sqlalchemy.engines [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87216) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writer thread running {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG cinder.db.api [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Building query based on filter {{(pid=87216) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87216) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:49 devstack cinder-volume[87216]: INFO cinder.keymgr.migration [None req-a8423535-4150-4e33-9b94-7f8580e98098 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 03:00:49 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:00:49 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:50 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.686s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:50 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Driver initialization completed successfully. Jul 09 03:00:50 devstack cinder-volume[87216]: INFO cinder.manager [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Initiating service 3 cleanup Jul 09 03:00:50 devstack cinder-volume[87216]: INFO cinder.manager [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Service 3 cleanup completed. Jul 09 03:00:50 devstack cinder-volume[87216]: DEBUG cinder.service [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Creating RPC server for service cinder-volume {{(pid=87216) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 03:00:50 devstack cinder-volume[87216]: DEBUG cinder.service [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87216) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 03:00:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 03:00:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:50 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:00:50 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:50 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.611s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d0bc434c-5942-43ef-b279-b9f4e6c4921f None None] Driver post RPC initialization completed successfully. Jul 09 03:00:58 devstack cinder-volume[87024]: DEBUG dbcounter [-] [87024] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:01:00 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:01:00 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=2 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:01:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:01:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 6 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:01:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Flow 'volume_create_manager' (fdb1b6b9-1093-4286-b73c-e12ac2ec0e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4b6a5d-da03-43d2-b031-a05c917486fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4b6a5d-da03-43d2-b031-a05c917486fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1105861777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339a9854-1db2-4337-a173-f25cd1710b73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7ceac608f004b1f98ceb59e11e46df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:01:48Z,use_quota=True,user_id='0730a7078634415c896443250faae267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f758cf-478d-42a4-8858-69db3cbc4445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f758cf-478d-42a4-8858-69db3cbc4445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76530229-c931-4e8a-a428-92eb46001f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76530229-c931-4e8a-a428-92eb46001f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '339a9854-1db2-4337-a173-f25cd1710b73', 'volume_name': 'volume-339a9854-1db2-4337-a173-f25cd1710b73', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1643b8ef-92f3-4b9b-83ac-a15ae2bcc9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1643b8ef-92f3-4b9b-83ac-a15ae2bcc9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffd75ec-0580-452d-8e9f-bae3d435db13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:48 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Volume 339a9854-1db2-4337-a173-f25cd1710b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-339a9854-1db2-4337-a173-f25cd1710b73', 'volume_size': 1} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1105861777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339a9854-1db2-4337-a173-f25cd1710b73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7ceac608f004b1f98ceb59e11e46df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:01:48Z,use_quota=True,user_id='0730a7078634415c896443250faae267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Creating volume 339a9854-1db2-4337-a173-f25cd1710b73 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:01:48 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:48 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73 1073741824 Jul 09 03:01:48 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Flow 'volume_create_manager' (194d101c-843e-4346-a177-87fb59f4ecd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:01:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a454eb34-e0a9-44db-9506-1f7890ac67c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a454eb34-e0a9-44db-9506-1f7890ac67c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1754984077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c5c998-b099-445f-9e6f-7e1c98fa7605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8280903e4b4766bd80bb02dd6e4523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:01:48Z,use_quota=True,user_id='8c9f78acab7c4c53a2de416655cd8f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdd892d-ab7a-4561-85d5-ad55040568c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdd892d-ab7a-4561-85d5-ad55040568c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0138e3-956f-4ba6-95c0-da970dec8ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0138e3-956f-4ba6-95c0-da970dec8ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c5c998-b099-445f-9e6f-7e1c98fa7605', 'volume_name': 'volume-44c5c998-b099-445f-9e6f-7e1c98fa7605', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e403400e-a9b0-4439-829b-2806f5904252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e403400e-a9b0-4439-829b-2806f5904252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950d26cf-dad5-4a98-b48e-b661db9f7335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:49 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Volume 44c5c998-b099-445f-9e6f-7e1c98fa7605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c5c998-b099-445f-9e6f-7e1c98fa7605', 'volume_size': 1} Jul 09 03:01:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:50 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73 1073741824" returned: 0 in 1.220s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:50 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73 Jul 09 03:01:50 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:50 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73" returned: 0 in 0.778s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.769s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1754984077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c5c998-b099-445f-9e6f-7e1c98fa7605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8280903e4b4766bd80bb02dd6e4523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:01:48Z,use_quota=True,user_id='8c9f78acab7c4c53a2de416655cd8f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Creating volume 44c5c998-b099-445f-9e6f-7e1c98fa7605 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:01:50 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:50 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 1073741824 Jul 09 03:01:50 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffd75ec-0580-452d-8e9f-bae3d435db13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339a9854-1db2-4337-a173-f25cd1710b73', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16ad29f-c659-4bf6-9cc9-cfb458aa4068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:50 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Volume volume-339a9854-1db2-4337-a173-f25cd1710b73 (339a9854-1db2-4337-a173-f25cd1710b73): created successfully Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16ad29f-c659-4bf6-9cc9-cfb458aa4068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Flow 'volume_create_manager' (fdb1b6b9-1093-4286-b73c-e12ac2ec0e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:01:51 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-5f009396-3d03-41b9-9615-0a87fa9cc5ca req-3e1818b6-1bf1-43ce-856d-2dbc2f03b503 tempest-VolumesGetTestJSON-1460151460 None] Created volume successfully. Jul 09 03:01:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Acquiring lock "cinder-339a9854-1db2-4337-a173-f25cd1710b73-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:01:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Lock "cinder-339a9854-1db2-4337-a173-f25cd1710b73-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:01:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Acquiring lock "cinder-quobyte-339a9854-1db2-4337-a173-f25cd1710b73" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:01:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Lock "cinder-quobyte-339a9854-1db2-4337-a173-f25cd1710b73" acquired by "delete_volume" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:01:52 devstack cinder-volume[87216]: INFO oslo.privsep.daemon [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5ltb8gbm/privsep.sock'] Jul 09 03:01:52 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 1073741824" returned: 0 in 1.322s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:52 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5ltb8gbm/privsep.sock Jul 09 03:01:52 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:52 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 Jul 09 03:01:52 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:52 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 09 03:01:52 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 03:01:52 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 03:01:52 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 03:01:52 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 03:01:52 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 03:01:52 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 03:01:52 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 03:01:52 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 09 03:01:52 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605" returned: 0 in 0.735s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:01:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950d26cf-dad5-4a98-b48e-b661db9f7335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c5c998-b099-445f-9e6f-7e1c98fa7605', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befcfd6e-51f3-4e34-8c95-0cb433ab7793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:53 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Volume volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 (44c5c998-b099-445f-9e6f-7e1c98fa7605): created successfully Jul 09 03:01:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befcfd6e-51f3-4e34-8c95-0cb433ab7793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Flow 'volume_create_manager' (194d101c-843e-4346-a177-87fb59f4ecd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:01:53 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-63990c71-6ac4-456c-a9e5-badad98af14b tempest-DeleteServersTestJSON-406465904 None] Created volume successfully. Jul 09 03:01:53 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 09 03:01:53 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 03:01:53 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 03:01:53 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 03:01:53 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 03:01:53 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 03:01:53 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 03:01:53 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 03:01:53 devstack cinder-volume[87216]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 09 03:01:53 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:53 devstack cinder-volume[87216]: INFO oslo.privsep.daemon [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Spawned new privsep daemon via rootwrap Jul 09 03:01:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Accepted privsep connection to /tmp/tmp5ltb8gbm/privsep.sock {{(pid=87216) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 09 03:01:53 devstack cinder-volume[87216]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 09 03:01:53 devstack cinder-volume[87216]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 09 03:01:53 devstack cinder-volume[87216]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 09 03:01:53 devstack cinder-volume[87216]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88178 Jul 09 03:01:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf6a187-f45b-4c5d-b2a9-508e6e1ab2a8]: (2,) {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[384b5cca-29dd-4655-b2a0-430b35d82ae2]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:53 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73 Jul 09 03:01:53 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:54 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73" returned: 0 in 0.806s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:54 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73 Jul 09 03:01:54 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:55 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-339a9854-1db2-4337-a173-f25cd1710b73" returned: 0 in 0.656s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Lock "cinder-quobyte-339a9854-1db2-4337-a173-f25cd1710b73" released by "delete_volume" :: held 3.120s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:01:55 devstack cinder-volume[87216]: WARNING cinder.quota [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:01:55 devstack cinder-volume[87216]: WARNING cinder.quota [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:01:55 devstack cinder-volume[87216]: DEBUG cinder.quota [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Created reservations ['6f9c9af1-cc46-4105-852a-0339b76bd5cf', '0ffab08b-4d5e-4542-bf9d-5ba514042d35', '54687043-3135-4c3a-be67-46124cbddb58', '89e5b623-031a-40e3-be38-c6b3123b3211'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:01:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:01:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:01:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:55 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:01:55 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:56 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.711s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:56 devstack cinder-volume[87216]: DEBUG cinder.manager [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:01:56 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Deleted volume successfully. Jul 09 03:01:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-ae4bf353-c793-40fd-a98a-afa5f2fa2923 req-084730cd-ae9f-48f8-b912-ccd08ebcddf0 tempest-VolumesGetTestJSON-1460151460 None] Lock "cinder-339a9854-1db2-4337-a173-f25cd1710b73-delete_volume" released by "delete_volume" :: held 4.129s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:01:59 devstack cinder-volume[87216]: WARNING py.warnings [req-00d389f1-0ad4-4f13-adf5-bab380b20df6 req-effddfb5-13a2-42ec-b355-2d104c7fdcbe tempest-DeleteServersTestJSON-406465904 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 09 03:01:59 devstack cinder-volume[87216]: .first() Jul 09 03:01:59 devstack cinder-volume[87216]: Jul 09 03:01:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-00d389f1-0ad4-4f13-adf5-bab380b20df6 req-effddfb5-13a2-42ec-b355-2d104c7fdcbe tempest-DeleteServersTestJSON-406465904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-00d389f1-0ad4-4f13-adf5-bab380b20df6 req-effddfb5-13a2-42ec-b355-2d104c7fdcbe tempest-DeleteServersTestJSON-406465904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:59 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc9ce43-7bdf-4f32-9070-011015403ca4]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-00d389f1-0ad4-4f13-adf5-bab380b20df6 req-effddfb5-13a2-42ec-b355-2d104c7fdcbe tempest-DeleteServersTestJSON-406465904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:59 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 Jul 09 03:01:59 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:00 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-00d389f1-0ad4-4f13-adf5-bab380b20df6 req-effddfb5-13a2-42ec-b355-2d104c7fdcbe tempest-DeleteServersTestJSON-406465904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605" returned: 0 in 0.965s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-00d389f1-0ad4-4f13-adf5-bab380b20df6 req-effddfb5-13a2-42ec-b355-2d104c7fdcbe tempest-DeleteServersTestJSON-406465904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.985s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-00d389f1-0ad4-4f13-adf5-bab380b20df6 req-effddfb5-13a2-42ec-b355-2d104c7fdcbe tempest-DeleteServersTestJSON-406465904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-44c5c998-b099-445f-9e6f-7e1c98fa7605', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03e50583-efbc-4441-a9ea-cce8426b14b2', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:02:00 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-00d389f1-0ad4-4f13-adf5-bab380b20df6 req-effddfb5-13a2-42ec-b355-2d104c7fdcbe tempest-DeleteServersTestJSON-406465904 None] attachment_update completed successfully. Jul 09 03:02:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f68180d8-76fc-45a3-872b-a11d81ea5bc5 tempest-GroupSnapshotsV319Test-1650352398 None] Group tempest-GroupSnapshotsV319Test-Group-1872045052: creating Jul 09 03:02:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f68180d8-76fc-45a3-872b-a11d81ea5bc5 tempest-GroupSnapshotsV319Test-1650352398 None] Group tempest-GroupSnapshotsV319Test-Group-1872045052: created successfully Jul 09 03:02:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f68180d8-76fc-45a3-872b-a11d81ea5bc5 tempest-GroupSnapshotsV319Test-1650352398 None] Create group completed successfully. Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Flow 'volume_create_manager' (905d808e-aeaa-46c0-8cd4-211e2998bfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d001ee-8de2-4a6e-89b7-6eb3adbdcef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d001ee-8de2-4a6e-89b7-6eb3adbdcef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1356844513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab3c4112ba242c9bfdfff3ce93c5320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:02:03Z,use_quota=True,user_id='21a446a0837b4a62b66e4526c68dfc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28396c97-4d75-4b90-95e3-2f41ab333d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28396c97-4d75-4b90-95e3-2f41ab333d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9b55e2-9aeb-4731-8b24-1c177ba24a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9b55e2-9aeb-4731-8b24-1c177ba24a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed', 'volume_name': 'volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e54d88c-1d50-448e-a281-8255e63a6d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e54d88c-1d50-448e-a281-8255e63a6d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051827ca-c1e8-404c-b179-fe114a3de672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:03 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Volume 2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed', 'volume_size': 1} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1356844513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab3c4112ba242c9bfdfff3ce93c5320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:02:03Z,use_quota=True,user_id='21a446a0837b4a62b66e4526c68dfc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Creating volume 2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:02:03 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:03 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed 1073741824 Jul 09 03:02:03 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Flow 'volume_create_manager' (0454dc3a-61d2-4c99-ad71-7cdf9f9e6a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6ecfbd-cc91-4e84-ada1-2466b12dd76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6ecfbd-cc91-4e84-ada1-2466b12dd76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323198776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8faf80c2-c250-42bb-8066-597025cb590c,host='devstack@QuobyteHD#QuobyteHD',id=e822f4d9-3859-4536-8e4b-d8c18e64015d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e916edac3d334d4dabddf8bbeeed4780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:02:03Z,use_quota=True,user_id='acc49a4c3cc7443fa267019caa56edc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b0b3869-7d7a-489d-ae2d-d7f1c7bc42c2),volume_type_id=5b0b3869-7d7a-489d-ae2d-d7f1c7bc42c2)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012e4696-a18a-45c3-93f6-a3aeb3786726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012e4696-a18a-45c3-93f6-a3aeb3786726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15b5dbc-94d6-433a-b03a-fb4d54d7886f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15b5dbc-94d6-433a-b03a-fb4d54d7886f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e822f4d9-3859-4536-8e4b-d8c18e64015d', 'volume_name': 'volume-e822f4d9-3859-4536-8e4b-d8c18e64015d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a8d1a3-ff1d-4bac-bb8b-764e4d24f7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a8d1a3-ff1d-4bac-bb8b-764e4d24f7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934f44be-4ee7-463c-9d3a-181cff493fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:03 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Volume e822f4d9-3859-4536-8e4b-d8c18e64015d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e822f4d9-3859-4536-8e4b-d8c18e64015d', 'volume_size': 1} Jul 09 03:02:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:04 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed 1073741824" returned: 0 in 0.883s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:04 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed Jul 09 03:02:04 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:04 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed" returned: 0 in 0.674s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8faf80c2-c250-42bb-8066-597025cb590c,created_at=2026-07-09T01:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323198776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8faf80c2-c250-42bb-8066-597025cb590c,host='devstack@QuobyteHD#QuobyteHD',id=e822f4d9-3859-4536-8e4b-d8c18e64015d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e916edac3d334d4dabddf8bbeeed4780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:02:03Z,use_quota=True,user_id='acc49a4c3cc7443fa267019caa56edc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b0b3869-7d7a-489d-ae2d-d7f1c7bc42c2),volume_type_id=5b0b3869-7d7a-489d-ae2d-d7f1c7bc42c2)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Creating volume e822f4d9-3859-4536-8e4b-d8c18e64015d {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:02:04 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051827ca-c1e8-404c-b179-fe114a3de672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fe69b9-9b48-4cab-b05a-31be48eae16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:04 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d 1073741824 Jul 09 03:02:04 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:04 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Volume volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed (2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed): created successfully Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fe69b9-9b48-4cab-b05a-31be48eae16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Flow 'volume_create_manager' (905d808e-aeaa-46c0-8cd4-211e2998bfaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:02:04 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6a9bd97d-6d2a-429a-90b1-6c6fe8a390f3 tempest-AttachVolumeNegativeTest-1162607623 None] Created volume successfully. Jul 09 03:02:06 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d 1073741824" returned: 0 in 1.137s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:06 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d Jul 09 03:02:06 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:06 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d" returned: 0 in 0.636s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:02:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934f44be-4ee7-463c-9d3a-181cff493fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e822f4d9-3859-4536-8e4b-d8c18e64015d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9314baeb-1256-4326-8649-f7cea086cc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:06 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Volume volume-e822f4d9-3859-4536-8e4b-d8c18e64015d (e822f4d9-3859-4536-8e4b-d8c18e64015d): created successfully Jul 09 03:02:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9314baeb-1256-4326-8649-f7cea086cc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Flow 'volume_create_manager' (0454dc3a-61d2-4c99-ad71-7cdf9f9e6a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:02:06 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b0dc10dd-491e-40d9-bfab-1f7a54d27b76 tempest-GroupSnapshotsV319Test-1650352398 None] Created volume successfully. Jul 09 03:02:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] GroupSnapshot bab0ec76-67a5-466f-986a-7e2fec8b9901: creating. Jul 09 03:02:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] Group snapshot bab0ec76-67a5-466f-986a-7e2fec8b9901: creating. {{(pid=87216) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 03:02:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] Creating offline snapshot 2c51a977-110c-4bb4-b265-3479434e7341 of volume e822f4d9-3859-4536-8e4b-d8c18e64015d {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:02:08 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3795230d-cac6-4765-9d19-a3c219d788b8]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:02:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:08 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d Jul 09 03:02:08 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-49105329-37d7-406e-88a1-4453407835a9 req-915b2f6a-73a4-4eca-9cae-0bd71e3d22d8 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:09 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d" returned: 0 in 0.844s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:09 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 1G Jul 09 03:02:09 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-c3d0cbe2-743f-4987-9865-5ced4ad4b429 req-a10e3f36-2630-4a3c-a1f3-8743ca15a654 tempest-DeleteServersTestJSON-406465904 None] Terminate volume connection completed successfully. Jul 09 03:02:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-c3d0cbe2-743f-4987-9865-5ced4ad4b429 req-a10e3f36-2630-4a3c-a1f3-8743ca15a654 tempest-DeleteServersTestJSON-406465904 None] Deleting attachment 03e50583-efbc-4441-a9ea-cce8426b14b2. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:02:10 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 1G" returned: 0 in 0.942s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e822f4d9-3859-4536-8e4b-d8c18e64015d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:10 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e822f4d9-3859-4536-8e4b-d8c18e64015d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 Jul 09 03:02:10 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:11 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e822f4d9-3859-4536-8e4b-d8c18e64015d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341" returned: 0 in 0.699s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:11 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:02:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:11 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 Jul 09 03:02:11 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:11 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341" returned: 0 in 0.632s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:11 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.info Jul 09 03:02:11 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:12 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.info" returned: 0 in 0.716s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:12 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:02:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:12 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.info Jul 09 03:02:12 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:13 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.info" returned: 0 in 0.731s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.661s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-49105329-37d7-406e-88a1-4453407835a9 req-915b2f6a-73a4-4eca-9cae-0bd71e3d22d8 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.915s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ec418a-9552-474a-af07-16d90f8c1270]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-49105329-37d7-406e-88a1-4453407835a9 req-915b2f6a-73a4-4eca-9cae-0bd71e3d22d8 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-cee89262-8604-452e-a748-541bb80be86d tempest-GroupSnapshotsV319Test-1650352398 None] group_snapshot bab0ec76-67a5-466f-986a-7e2fec8b9901: created successfully Jul 09 03:02:13 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed Jul 09 03:02:13 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:13 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:02:13 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Acquiring lock "cinder-44c5c998-b099-445f-9e6f-7e1c98fa7605-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Lock "cinder-44c5c998-b099-445f-9e6f-7e1c98fa7605-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:02:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Acquiring lock "cinder-quobyte-44c5c998-b099-445f-9e6f-7e1c98fa7605" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Lock "cinder-quobyte-44c5c998-b099-445f-9e6f-7e1c98fa7605" acquired by "delete_volume" :: waited 0.038s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82594719-22db-4f2b-9299-7a19b3c5bfd1]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:14 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-49105329-37d7-406e-88a1-4453407835a9 req-915b2f6a-73a4-4eca-9cae-0bd71e3d22d8 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed" returned: 0 in 0.975s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-49105329-37d7-406e-88a1-4453407835a9 req-915b2f6a-73a4-4eca-9cae-0bd71e3d22d8 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.999s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:14 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 Jul 09 03:02:14 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-49105329-37d7-406e-88a1-4453407835a9 req-915b2f6a-73a4-4eca-9cae-0bd71e3d22d8 tempest-AttachVolumeNegativeTest-1162607623 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d978870-0cec-4f5c-8f88-2bb3035306e9', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:02:14 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-49105329-37d7-406e-88a1-4453407835a9 req-915b2f6a-73a4-4eca-9cae-0bd71e3d22d8 tempest-AttachVolumeNegativeTest-1162607623 None] attachment_update completed successfully. Jul 09 03:02:14 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] group_snapshot bab0ec76-67a5-466f-986a-7e2fec8b9901: deleting Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] group_snapshot bab0ec76-67a5-466f-986a-7e2fec8b9901: deleting {{(pid=87216) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Acquiring lock "cinder-quobyte-e822f4d9-3859-4536-8e4b-d8c18e64015d" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Lock "cinder-quobyte-e822f4d9-3859-4536-8e4b-d8c18e64015d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Acquiring lock "cinder-quobyte-2c51a977-110c-4bb4-b265-3479434e7341" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Lock "cinder-quobyte-2c51a977-110c-4bb4-b265-3479434e7341" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Deleting offline snapshot 2c51a977-110c-4bb4-b265-3479434e7341 of volume e822f4d9-3859-4536-8e4b-d8c18e64015d {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:02:14 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] snapshot_file for this snap is: volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.069s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 8 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f224109-fec3-431d-b1e3-4c3c21498119]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:02:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:15 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 Jul 09 03:02:15 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:15 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605" returned: 0 in 1.275s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:15 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605 Jul 09 03:02:15 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:15 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341" returned: 0 in 1.058s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e822f4d9-3859-4536-8e4b-d8c18e64015d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:02:15 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd7ff76-b702-4eaa-a7d6-d70a9c0886c8]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:02:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:16 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d Jul 09 03:02:16 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:16 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44c5c998-b099-445f-9e6f-7e1c98fa7605" returned: 0 in 0.903s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Lock "cinder-quobyte-44c5c998-b099-445f-9e6f-7e1c98fa7605" released by "delete_volume" :: held 2.247s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:02:16 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Created reservations ['988f756f-f1c1-4f0f-8d3b-2d4014dbe26d', 'd3ae6f96-2e63-4b8e-9141-6c56eca6b6b2', '1d098ee8-0f61-404d-81a7-d7524b2e2cb6', '0798148f-89c0-410f-97d3-2450eea41be5'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:02:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:02:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:02:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:16 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:02:16 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:16 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d" returned: 0 in 0.792s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:16 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 Jul 09 03:02:16 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:17 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.702s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:17 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:02:17 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Deleted volume successfully. Jul 09 03:02:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf64ef77-d573-46c7-9e67-322f302e907a tempest-DeleteServersTestJSON-406465904 None] Lock "cinder-44c5c998-b099-445f-9e6f-7e1c98fa7605-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:02:17 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341" returned: 0 in 0.841s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:17 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341 Jul 09 03:02:17 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:18 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d.2c51a977-110c-4bb4-b265-3479434e7341" returned: 0 in 0.753s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Lock "cinder-quobyte-2c51a977-110c-4bb4-b265-3479434e7341" released by "_delete_snapshot" :: held 3.589s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:02:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Lock "cinder-quobyte-e822f4d9-3859-4536-8e4b-d8c18e64015d" released by "delete_snapshot" :: held 3.625s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:02:18 devstack cinder-volume[87216]: WARNING cinder.quota [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1257759554 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1257759554, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:02:18 devstack cinder-volume[87216]: WARNING cinder.quota [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1257759554 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1257759554, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:02:18 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] Created reservations ['ee8178b8-a171-4c9b-ae4c-2b0110fe2fa3', '4a5c2120-9787-48e0-9b41-708f5f8275b6', '1bc60fd8-b7ad-49de-930c-dd04e97960a4', 'afbc2f03-cd96-44ad-8e31-64bc57da55de'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:02:18 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-929ea2ea-462d-4b76-956c-a3db2197af8f tempest-GroupSnapshotsV319Test-1650352398 None] group_snapshot bab0ec76-67a5-466f-986a-7e2fec8b9901: deleted successfully Jul 09 03:02:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Acquiring lock "cinder-quobyte-e822f4d9-3859-4536-8e4b-d8c18e64015d" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:02:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Lock "cinder-quobyte-e822f4d9-3859-4536-8e4b-d8c18e64015d" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:02:19 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2491a0ae-47a0-4015-afaf-3c33d65ec7bb]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:02:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:19 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d Jul 09 03:02:19 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:20 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d" returned: 0 in 0.843s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:20 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d Jul 09 03:02:20 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:21 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e822f4d9-3859-4536-8e4b-d8c18e64015d" returned: 0 in 0.796s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Lock "cinder-quobyte-e822f4d9-3859-4536-8e4b-d8c18e64015d" released by "delete_volume" :: held 1.725s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:02:21 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Created reservations ['b1dc5753-d126-4214-8747-f79b455463b6'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:02:21 devstack cinder-volume[87216]: WARNING cinder.quota [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1257759554 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1257759554, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:02:21 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Created reservations ['8ac1bc9a-357f-4bf8-afcc-b3dde29f4298', '283c8334-0b56-457f-9280-87934235a2bc', 'a05d2704-d60f-4c94-b7b1-52b3c27271ce', '1706cd52-b7a0-469e-9911-e1862f339a6f'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:02:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:02:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:02:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:21 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:02:21 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:22 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.002s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:22 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:02:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6583bdfb-30f2-48a3-8f66-46923685bdbe tempest-GroupSnapshotsV319Test-1650352398 None] Delete group completed successfully. Jul 09 03:02:31 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=47,cinder:SELECT=50,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:02:31 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=55,cinder:UPDATE=55,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Flow 'volume_create_manager' (b50ac8de-fbc5-43a6-8b31-c5a7532ab4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57f80c1-d5e2-4abe-8ecc-69743541a38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57f80c1-d5e2-4abe-8ecc-69743541a38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2115626683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c8f62b-65c3-4e0b-80ba-e31f2608a345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c705964fd08241d7a46967d4b1ee94d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:02:50Z,use_quota=True,user_id='a98cecb959fa49879ceab65ef13bcb4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14f80e3-6c76-4a3a-932b-38c95dd3f3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14f80e3-6c76-4a3a-932b-38c95dd3f3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ac0b9f-5a55-49ba-bbe2-a73fe3c50614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ac0b9f-5a55-49ba-bbe2-a73fe3c50614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c8f62b-65c3-4e0b-80ba-e31f2608a345', 'volume_name': 'volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd3a123-503e-42c6-a547-bc89cbd551af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd3a123-503e-42c6-a547-bc89cbd551af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca80d10-ee5a-427a-a647-60f98616ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:49 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Volume 80c8f62b-65c3-4e0b-80ba-e31f2608a345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345', 'volume_size': 1} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2115626683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c8f62b-65c3-4e0b-80ba-e31f2608a345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c705964fd08241d7a46967d4b1ee94d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:02:50Z,use_quota=True,user_id='a98cecb959fa49879ceab65ef13bcb4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Creating volume 80c8f62b-65c3-4e0b-80ba-e31f2608a345 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:02:49 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:02:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:49 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345 1073741824 Jul 09 03:02:49 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:50 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345 1073741824" returned: 0 in 0.846s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:50 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345 Jul 09 03:02:50 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:51 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345" returned: 0 in 0.675s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:02:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca80d10-ee5a-427a-a647-60f98616ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ac9e4e-bde2-483a-9ba1-981d27685727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:51 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Volume volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345 (80c8f62b-65c3-4e0b-80ba-e31f2608a345): created successfully Jul 09 03:02:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ac9e4e-bde2-483a-9ba1-981d27685727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Flow 'volume_create_manager' (b50ac8de-fbc5-43a6-8b31-c5a7532ab4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:02:51 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1c83324e-ca0e-40b7-b0d4-51b579fc2054 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Created volume successfully. Jul 09 03:02:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Acquiring lock "cinder-80c8f62b-65c3-4e0b-80ba-e31f2608a345-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:02:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Lock "cinder-80c8f62b-65c3-4e0b-80ba-e31f2608a345-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:02:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Acquiring lock "cinder-quobyte-80c8f62b-65c3-4e0b-80ba-e31f2608a345" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:02:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Lock "cinder-quobyte-80c8f62b-65c3-4e0b-80ba-e31f2608a345" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:02:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc08fa4e-315b-442e-bb4d-3e46af875169]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:02:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:53 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345 Jul 09 03:02:53 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:54 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345" returned: 0 in 0.931s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:54 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345 Jul 09 03:02:54 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:55 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-80c8f62b-65c3-4e0b-80ba-e31f2608a345" returned: 0 in 1.339s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Lock "cinder-quobyte-80c8f62b-65c3-4e0b-80ba-e31f2608a345" released by "delete_volume" :: held 2.363s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:02:55 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Created reservations ['38997b19-fa2e-4a9e-98a2-be992657f38b', '771203ac-06ce-49e9-9e88-5ff12c1537fb', '8ca4bae9-a1bd-451f-b459-491542e3f5d4', 'b5af4426-0e2c-4e14-a2af-2b7b1df5eba4'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:02:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:02:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:02:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:56 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:02:56 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:56 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.010s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:56 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:02:57 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Deleted volume successfully. Jul 09 03:02:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5a2acc48-217f-4a95-a42c-8d41fb12c421 tempest-VolumeQuotasNegativeTestJSON-1919951274 None] Lock "cinder-80c8f62b-65c3-4e0b-80ba-e31f2608a345-delete_volume" released by "delete_volume" :: held 3.839s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:05 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=11,cinder:UPDATE=14,cinder:INSERT=3 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Flow 'volume_create_manager' (d4f5fa93-349b-4343-95ca-06a208ca5b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdc7fb7-05d1-464c-b01e-25b77ce927e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdc7fb7-05d1-464c-b01e-25b77ce927e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1057351932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37eacbc1-e25f-4821-ad26-d6be7d663ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1690e0359f417d9f773e491cd93108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:07Z,use_quota=True,user_id='9b9f777cfc5a4f228ae73b46b3cec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869f750b-459c-4d55-85e1-d96e5e4fe198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869f750b-459c-4d55-85e1-d96e5e4fe198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73715bb3-841e-4b5f-86ac-c1a08210d752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73715bb3-841e-4b5f-86ac-c1a08210d752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37eacbc1-e25f-4821-ad26-d6be7d663ad9', 'volume_name': 'volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef34702-89f1-440f-993b-0380a5d68652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef34702-89f1-440f-993b-0380a5d68652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2d82f3-3c12-47e6-951b-068aeb704d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:07 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Volume 37eacbc1-e25f-4821-ad26-d6be7d663ad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9', 'volume_size': 1} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1057351932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37eacbc1-e25f-4821-ad26-d6be7d663ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1690e0359f417d9f773e491cd93108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:07Z,use_quota=True,user_id='9b9f777cfc5a4f228ae73b46b3cec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Creating volume 37eacbc1-e25f-4821-ad26-d6be7d663ad9 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:07 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:03:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:07 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 1073741824 Jul 09 03:03:07 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:08 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 1073741824" returned: 0 in 1.346s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:08 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 Jul 09 03:03:08 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:09 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9" returned: 0 in 0.849s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:03:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2d82f3-3c12-47e6-951b-068aeb704d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcde78f4-2cd0-4f9f-aeab-b307cd117ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:09 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Volume volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 (37eacbc1-e25f-4821-ad26-d6be7d663ad9): created successfully Jul 09 03:03:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcde78f4-2cd0-4f9f-aeab-b307cd117ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Flow 'volume_create_manager' (d4f5fa93-349b-4343-95ca-06a208ca5b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:09 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6486b7f1-9383-4897-8fd9-b14ecaa9c8dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Created volume successfully. Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Creating offline snapshot b4c4cd32-793b-406c-93cc-2cb1c2f5347c of volume 37eacbc1-e25f-4821-ad26-d6be7d663ad9 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Flow 'volume_create_manager' (ceb078bb-c17f-4535-aeca-245b557e0ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b6486d-ed1c-4099-988d-67b709a2409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac266920-1924-41a1-9517-048e2435c580]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b6486d-ed1c-4099-988d-67b709a2409a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1954889165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b240d73-62cb-4af5-b51c-5e6d65fde4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c524518f8b4cf98eea5eb468dd33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:11Z,use_quota=True,user_id='e303ae742a0744a79dae08436871600c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe8069d-6812-40bf-bc91-bce34dd66c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe8069d-6812-40bf-bc91-bce34dd66c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f751bc4-f11d-4dd7-9829-dc48238145be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f751bc4-f11d-4dd7-9829-dc48238145be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b240d73-62cb-4af5-b51c-5e6d65fde4e9', 'volume_name': 'volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72113eea-3722-43df-bcc6-235dcfb8d6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72113eea-3722-43df-bcc6-235dcfb8d6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4052130e-e911-4199-b79b-eac7dde8e100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:11 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Volume 8b240d73-62cb-4af5-b51c-5e6d65fde4e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9', 'volume_size': 1} Jul 09 03:03:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:11 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 Jul 09 03:03:11 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:12 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9" returned: 0 in 0.917s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:12 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c 1G Jul 09 03:03:12 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:12 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c 1G" returned: 0 in 0.791s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:12 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c Jul 09 03:03:12 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:13 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c" returned: 0 in 0.746s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:13 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c is being set with open permissions: ugo+rw Jul 09 03:03:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:13 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c Jul 09 03:03:13 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:03:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:13 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:03:13 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:14 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c" returned: 0 in 0.924s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:14 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.info Jul 09 03:03:14 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:15 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.246s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:15 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:03:15 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.info" returned: 0 in 0.863s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:15 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.info is being set with open permissions: ugo+rw Jul 09 03:03:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:15 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.info Jul 09 03:03:15 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:16 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.info" returned: 0 in 0.713s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.176s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.983s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1954889165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b240d73-62cb-4af5-b51c-5e6d65fde4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c524518f8b4cf98eea5eb468dd33c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:11Z,use_quota=True,user_id='e303ae742a0744a79dae08436871600c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Creating volume 8b240d73-62cb-4af5-b51c-5e6d65fde4e9 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:16 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:03:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:16 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9 1073741824 Jul 09 03:03:16 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:16 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b5d3aea6-739a-4e40-9761-edf35bbe10c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Create snapshot completed successfully Jul 09 03:03:17 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9 1073741824" returned: 0 in 0.864s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:17 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9 Jul 09 03:03:17 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Acquiring lock "cinder-b4c4cd32-793b-406c-93cc-2cb1c2f5347c-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:18 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "cinder-b4c4cd32-793b-406c-93cc-2cb1c2f5347c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Acquiring lock "cinder-quobyte-37eacbc1-e25f-4821-ad26-d6be7d663ad9" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9" returned: 0 in 0.840s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "cinder-quobyte-37eacbc1-e25f-4821-ad26-d6be7d663ad9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Acquiring lock "cinder-quobyte-b4c4cd32-793b-406c-93cc-2cb1c2f5347c" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4052130e-e911-4199-b79b-eac7dde8e100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd54b1e-3236-4b3b-be8f-22c7b5377db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "cinder-quobyte-b4c4cd32-793b-406c-93cc-2cb1c2f5347c" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Deleting offline snapshot b4c4cd32-793b-406c-93cc-2cb1c2f5347c of volume 37eacbc1-e25f-4821-ad26-d6be7d663ad9 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] snapshot_file for this snap is: volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:03:18 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Volume volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9 (8b240d73-62cb-4af5-b51c-5e6d65fde4e9): created successfully Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd54b1e-3236-4b3b-be8f-22c7b5377db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Flow 'volume_create_manager' (ceb078bb-c17f-4535-aeca-245b557e0ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a49a98c-ef68-48b1-83ce-4f494e6ec071]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:18 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-013b07f8-2dbb-4bc4-af12-5d5e2fa9cefd tempest-VolumesAdminNegativeTest-864280530 None] Created volume successfully. Jul 09 03:03:18 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c Jul 09 03:03:18 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:19 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c" returned: 0 in 0.972s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:03:19 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3fd62a-17b9-4ffa-8efc-c7159135d92b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Acquiring lock "cinder-8b240d73-62cb-4af5-b51c-5e6d65fde4e9-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Lock "cinder-8b240d73-62cb-4af5-b51c-5e6d65fde4e9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Acquiring lock "cinder-quobyte-8b240d73-62cb-4af5-b51c-5e6d65fde4e9" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Lock "cinder-quobyte-8b240d73-62cb-4af5-b51c-5e6d65fde4e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:19 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 Jul 09 03:03:19 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:19 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d0434-5b79-47a4-8ea2-09e32b3f658a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:19 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9 Jul 09 03:03:19 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:20 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9" returned: 0 in 0.918s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:20 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c Jul 09 03:03:20 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:20 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9" returned: 0 in 0.907s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:20 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9 Jul 09 03:03:20 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:20 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c" returned: 0 in 0.826s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:20 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c Jul 09 03:03:20 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:21 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b240d73-62cb-4af5-b51c-5e6d65fde4e9" returned: 0 in 0.767s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Lock "cinder-quobyte-8b240d73-62cb-4af5-b51c-5e6d65fde4e9" released by "delete_volume" :: held 1.728s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Created reservations ['112b1fba-6560-4361-862c-89f89611674a', 'c0738d36-7475-4da0-834d-a097bd15c503', '21e93b54-545a-42aa-adee-3e46ea1bd0ef', '3d172b2e-73dc-4aad-927b-7460c0af37ad'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:21 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:03:21 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:21 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9.b4c4cd32-793b-406c-93cc-2cb1c2f5347c" returned: 0 in 0.910s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "cinder-quobyte-b4c4cd32-793b-406c-93cc-2cb1c2f5347c" released by "_delete_snapshot" :: held 3.775s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "cinder-quobyte-37eacbc1-e25f-4821-ad26-d6be7d663ad9" released by "delete_snapshot" :: held 3.834s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:22 devstack cinder-volume[87216]: WARNING cinder.quota [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:03:22 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Created reservations ['7a41f5a5-697b-41d8-ac0d-42a28d51b16d', '4e1f8347-4448-40d1-9de4-11aa9188ee52', '794fcc0b-0702-4a44-85a7-ae5d3dc08dff', 'e35c694c-f393-436e-aa3b-31e40b7e513c'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:03:22 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.894s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:22 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:03:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Deleted volume successfully. Jul 09 03:03:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-caae0b38-d3ce-4282-95a5-537ab0074caa tempest-VolumesAdminNegativeTest-864280530 None] Lock "cinder-8b240d73-62cb-4af5-b51c-5e6d65fde4e9-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Delete snapshot completed successfully. Jul 09 03:03:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-06a0aff0-c70a-45b3-a72f-ef736b446266 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "cinder-b4c4cd32-793b-406c-93cc-2cb1c2f5347c-delete_snapshot" released by "delete_snapshot" :: held 4.181s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Acquiring lock "cinder-37eacbc1-e25f-4821-ad26-d6be7d663ad9-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "cinder-37eacbc1-e25f-4821-ad26-d6be7d663ad9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Acquiring lock "cinder-quobyte-37eacbc1-e25f-4821-ad26-d6be7d663ad9" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "cinder-quobyte-37eacbc1-e25f-4821-ad26-d6be7d663ad9" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:22 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6abf85-21a2-4e98-9815-1c23b27ae258]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:22 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 Jul 09 03:03:22 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:23 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9" returned: 0 in 0.758s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:23 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9 Jul 09 03:03:23 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:24 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37eacbc1-e25f-4821-ad26-d6be7d663ad9" returned: 0 in 1.002s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "cinder-quobyte-37eacbc1-e25f-4821-ad26-d6be7d663ad9" released by "delete_volume" :: held 1.833s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:24 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Created reservations ['fbdd70af-13ad-4002-a342-009db4a4e43c', '358a8cb2-ef45-4815-9965-81061c2b2ea4', 'e9fe7750-f503-46e3-8c7d-d5575e293ccf', '5d48e9f1-67d5-49a7-8955-8f6772a7356e'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:03:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:24 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:03:24 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:25 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.998s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:25 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:03:25 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Deleted volume successfully. Jul 09 03:03:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da801e49-a91f-4cfa-a300-5a2676050d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424458964 None] Lock "cinder-37eacbc1-e25f-4821-ad26-d6be7d663ad9-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Flow 'volume_create_manager' (22b4cee3-8792-4f58-8450-cdbe89bc4580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70dabc00-b84a-40c5-bd78-e4ae9429272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70dabc00-b84a-40c5-bd78-e4ae9429272d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-166197311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724163d5-03c4-4696-9de7-5abeb62e6f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd739fdd8224a19bd214a04a57895ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:30Z,use_quota=True,user_id='c678d54f783f4dd5ad67340d80edd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18037278-f55a-4527-ae11-1bb26e8fd648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18037278-f55a-4527-ae11-1bb26e8fd648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd63dd7-905d-48d2-a6ea-464c2d89a976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd63dd7-905d-48d2-a6ea-464c2d89a976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724163d5-03c4-4696-9de7-5abeb62e6f9e', 'volume_name': 'volume-724163d5-03c4-4696-9de7-5abeb62e6f9e', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c9a6a9-c84c-479a-80ac-53004c68a771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c9a6a9-c84c-479a-80ac-53004c68a771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e7b517-4acc-4e8a-83ae-50bf79b35981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:29 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Volume 724163d5-03c4-4696-9de7-5abeb62e6f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724163d5-03c4-4696-9de7-5abeb62e6f9e', 'volume_size': 1} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-166197311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724163d5-03c4-4696-9de7-5abeb62e6f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd739fdd8224a19bd214a04a57895ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:30Z,use_quota=True,user_id='c678d54f783f4dd5ad67340d80edd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Creating volume 724163d5-03c4-4696-9de7-5abeb62e6f9e {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:29 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:03:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:29 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e 1073741824 Jul 09 03:03:29 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:31 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e 1073741824" returned: 0 in 1.221s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:31 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e Jul 09 03:03:31 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:32 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e" returned: 0 in 0.906s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] <== create_volume: return (2211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:03:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e7b517-4acc-4e8a-83ae-50bf79b35981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724163d5-03c4-4696-9de7-5abeb62e6f9e', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6180d3-d495-45b3-bfed-a414348f7dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:32 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Volume volume-724163d5-03c4-4696-9de7-5abeb62e6f9e (724163d5-03c4-4696-9de7-5abeb62e6f9e): created successfully Jul 09 03:03:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6180d3-d495-45b3-bfed-a414348f7dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Flow 'volume_create_manager' (22b4cee3-8792-4f58-8450-cdbe89bc4580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9079fae5-d7a8-45ea-a47d-07997dc99fff tempest-ServerActionsTestOtherA-1797345585 None] Created volume successfully. Jul 09 03:03:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-731e3e98-f2d8-435d-b334-a8c6a27c5a39 req-96de1583-5640-4a6f-acba-448ef9afe987 tempest-AttachVolumeNegativeTest-1162607623 None] Terminate volume connection completed successfully. Jul 09 03:03:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-731e3e98-f2d8-435d-b334-a8c6a27c5a39 req-96de1583-5640-4a6f-acba-448ef9afe987 tempest-AttachVolumeNegativeTest-1162607623 None] Deleting attachment 8d978870-0cec-4f5c-8f88-2bb3035306e9. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Flow 'volume_create_manager' (3ffeaff1-4725-4788-b400-11673626b47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9648987-b146-4e2f-b1c5-e59c8e383f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9648987-b146-4e2f-b1c5-e59c8e383f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1903071894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5afc426-53e6-4c33-915f-f2e1e5a883c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f8cf2201ad43efaa7f2ddfe43c35aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:41Z,use_quota=True,user_id='0136a879c6be40369bdc8997f47080b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41915a25-7bde-4106-b57a-8f63874b2103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41915a25-7bde-4106-b57a-8f63874b2103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d9115e-58a9-4043-a29f-706961d50a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.image.glance [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Creating Keystone auth plugin from conf {{(pid=87216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d9115e-58a9-4043-a29f-706961d50a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e5afc426-53e6-4c33-915f-f2e1e5a883c4', 'volume_name': 'volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2776a19a-a4ac-4e4f-a59a-544404baabb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2776a19a-a4ac-4e4f-a59a-544404baabb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdb7969-4ffc-45f5-8cb6-7f1cd0aa3236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:41 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Volume e5afc426-53e6-4c33-915f-f2e1e5a883c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 03:03:41 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Trying to clone e5afc426-53e6-4c33-915f-f2e1e5a883c4 from image ea6ec930-eba2-423b-9437-18da29841701 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]). {{(pid=87216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:03:42 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:03:42 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Image download 20.69 MB at 20.69 MB/s Jul 09 03:03:42 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4611cdbe-0d93-41b5-a359-3f289bcc7064]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:42 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD Jul 09 03:03:42 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:43 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD" returned: 0 in 0.878s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:43 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Temporary image ea6ec930-eba2-423b-9437-18da29841701 is fetched for user 0136a879c6be40369bdc8997f47080b4. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:03:43 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7d2644-d9c0-4ed6-9148-c6d5157ccff3]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:43 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD Jul 09 03:03:43 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:44 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD" returned: 0 in 0.838s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1903071894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5afc426-53e6-4c33-915f-f2e1e5a883c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f8cf2201ad43efaa7f2ddfe43c35aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:41Z,use_quota=True,user_id='0136a879c6be40369bdc8997f47080b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Creating volume e5afc426-53e6-4c33-915f-f2e1e5a883c4 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:44 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:03:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:44 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 1073741824 Jul 09 03:03:44 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:45 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 1073741824" returned: 0 in 0.970s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:45 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 Jul 09 03:03:45 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:45 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4" returned: 0 in 0.737s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:03:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:46 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Attempting download of ea6ec930-eba2-423b-9437-18da29841701 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}])) to volume e5afc426-53e6-4c33-915f-f2e1e5a883c4. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:03:46 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bdd833-a5be-45dd-8a8d-3d87d0f66a20]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_gzapabs4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:46 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_gzapabs4 Jul 09 03:03:46 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:46 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_gzapabs4" returned: 0 in 0.825s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_gzapabs4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:47 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_gzapabs4 Jul 09 03:03:47 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:47 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_gzapabs4" returned: 1 in 0.988s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_gzapabs4' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:03:47 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92fb294-ecb9-4d89-8432-f13bf9ccd4a0]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:48 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD Jul 09 03:03:48 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:49 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD" returned: 0 in 1.100s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:49 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] ea6ec930-eba2-423b-9437-18da29841701 was qcow2, converting to raw {{(pid=87216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:03:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:49 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 Jul 09 03:03:49 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:51 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4" returned: 0 in 2.636s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:51 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_lm4rlmtxdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:03:51 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Converted 112.00 MB image at 42.48 MB/s Jul 09 03:03:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:51 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 1G Jul 09 03:03:51 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:52 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 1G" returned: 0 in 0.944s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:52 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3e6fbd-dcc5-435c-9071-fbe0066d338c]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:52 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 Jul 09 03:03:52 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:53 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4" returned: 0 in 1.151s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:53 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 Jul 09 03:03:53 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:55 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4" returned: 1 in 1.315s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:03:55 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Downloaded image ea6ec930-eba2-423b-9437-18da29841701 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}])) to volume e5afc426-53e6-4c33-915f-f2e1e5a883c4 successfully. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:03:55 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Temporary image ea6ec930-eba2-423b-9437-18da29841701 for user 0136a879c6be40369bdc8997f47080b4 is deleted. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:03:55 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Marking volume e5afc426-53e6-4c33-915f-f2e1e5a883c4 as bootable. {{(pid=87216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:03:55 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Copying metadata from image ea6ec930-eba2-423b-9437-18da29841701 to e5afc426-53e6-4c33-915f-f2e1e5a883c4. {{(pid=87216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:03:55 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Creating volume glance metadata for volume e5afc426-53e6-4c33-915f-f2e1e5a883c4 backed by image ea6ec930-eba2-423b-9437-18da29841701 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:03:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdb7969-4ffc-45f5-8cb6-7f1cd0aa3236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a943852-80ea-4987-b48f-853266d9ca02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:55 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Volume volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 (e5afc426-53e6-4c33-915f-f2e1e5a883c4): created successfully Jul 09 03:03:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a943852-80ea-4987-b48f-853266d9ca02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Flow 'volume_create_manager' (3ffeaff1-4725-4788-b400-11673626b47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b76edea4-4d28-46d2-bee7-439e052ec8f4 tempest-VolumesImageMetadata-1369034021 None] Created volume successfully. Jul 09 03:03:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Acquiring lock "cinder-e5afc426-53e6-4c33-915f-f2e1e5a883c4-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Lock "cinder-e5afc426-53e6-4c33-915f-f2e1e5a883c4-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Acquiring lock "cinder-quobyte-e5afc426-53e6-4c33-915f-f2e1e5a883c4" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Lock "cinder-quobyte-e5afc426-53e6-4c33-915f-f2e1e5a883c4" acquired by "delete_volume" :: waited 0.073s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:58 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0501e63-d8ff-4d78-bf7d-8d44b7cb75e8]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:58 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 Jul 09 03:03:58 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:59 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4" returned: 0 in 1.164s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:59 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 Jul 09 03:03:59 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:00 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4" returned: 1 in 1.169s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:04:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:00 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4 Jul 09 03:04:00 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:01 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5afc426-53e6-4c33-915f-f2e1e5a883c4" returned: 0 in 1.176s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Lock "cinder-quobyte-e5afc426-53e6-4c33-915f-f2e1e5a883c4" released by "delete_volume" :: held 3.642s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:01 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Created reservations ['7cd0fc9a-554a-4cca-a70b-1fca1a6628b6', '996ced3a-99fc-4c05-8ce6-b9b4963f4ad0', '2ae3d1a1-4ad5-4b5c-80cc-75c3fc151965', '7b664bd2-7ab2-4edf-8b48-d48fd3a155b9'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:02 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:04:02 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:03 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.282s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:03 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:03 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Deleted volume successfully. Jul 09 03:04:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f93ac77f-a6c8-4318-a84a-5d3362538249 tempest-VolumesImageMetadata-1369034021 None] Lock "cinder-e5afc426-53e6-4c33-915f-f2e1e5a883c4-delete_volume" released by "delete_volume" :: held 5.416s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=44,cinder:UPDATE=51,cinder:DELETE=4,cinder:INSERT=13 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Flow 'volume_create_manager' (a9d2c286-113f-4ffc-b61a-1d2ff6341c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ba734e-c172-480c-8c66-aff15de0c60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ba734e-c172-480c-8c66-aff15de0c60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1804901594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b9db67-1759-42c6-a125-695c29f7bd03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2290c2c346f44029e9a99347dc4252d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:07Z,use_quota=True,user_id='3fdcc4673df149ff999b33538d475132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12bf650d-a3a7-4a04-8ace-d1bd44ec3f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12bf650d-a3a7-4a04-8ace-d1bd44ec3f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697bc0a5-4e34-4a69-ad1b-18a8237f9c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697bc0a5-4e34-4a69-ad1b-18a8237f9c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b9db67-1759-42c6-a125-695c29f7bd03', 'volume_name': 'volume-50b9db67-1759-42c6-a125-695c29f7bd03', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae53192-9c10-4305-a991-b43f48459ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae53192-9c10-4305-a991-b43f48459ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0514228-222f-4627-9c34-1f6828fab3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:06 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Volume 50b9db67-1759-42c6-a125-695c29f7bd03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b9db67-1759-42c6-a125-695c29f7bd03', 'volume_size': 1} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1804901594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b9db67-1759-42c6-a125-695c29f7bd03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2290c2c346f44029e9a99347dc4252d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:07Z,use_quota=True,user_id='3fdcc4673df149ff999b33538d475132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Creating volume 50b9db67-1759-42c6-a125-695c29f7bd03 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:06 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:04:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:06 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 1073741824 Jul 09 03:04:06 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:07 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 1073741824" returned: 0 in 0.927s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:07 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=40,cinder:UPDATE=39,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:04:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:07 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 Jul 09 03:04:07 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:08 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03" returned: 0 in 0.778s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:04:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0514228-222f-4627-9c34-1f6828fab3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b9db67-1759-42c6-a125-695c29f7bd03', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f767eadf-8dad-4310-89d2-c3dfd7fd3d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:08 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Volume volume-50b9db67-1759-42c6-a125-695c29f7bd03 (50b9db67-1759-42c6-a125-695c29f7bd03): created successfully Jul 09 03:04:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f767eadf-8dad-4310-89d2-c3dfd7fd3d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Flow 'volume_create_manager' (a9d2c286-113f-4ffc-b61a-1d2ff6341c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-127686d8-ab05-4b7b-9b31-01d87b47f74a tempest-SnapshotMetadataTestJSON-1378003522 None] Created volume successfully. Jul 09 03:04:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] Creating offline snapshot 96b49239-2d8c-4908-9b6e-b34f2ef566d7 of volume 50b9db67-1759-42c6-a125-695c29f7bd03 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:04:09 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d85cfc-6030-4280-8d97-5a57795f0356]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:09 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 Jul 09 03:04:09 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:10 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03" returned: 0 in 0.886s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:10 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 1G Jul 09 03:04:10 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:11 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 1G" returned: 0 in 1.269s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b9db67-1759-42c6-a125-695c29f7bd03 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:11 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b9db67-1759-42c6-a125-695c29f7bd03 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 Jul 09 03:04:11 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:12 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b9db67-1759-42c6-a125-695c29f7bd03 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7" returned: 0 in 0.978s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:12 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 is being set with open permissions: ugo+rw Jul 09 03:04:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:12 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 Jul 09 03:04:12 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:13 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7" returned: 0 in 0.963s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:13 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.info Jul 09 03:04:13 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:04:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:13 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:04:13 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:14 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.info" returned: 0 in 1.118s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:14 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.info is being set with open permissions: ugo+rw Jul 09 03:04:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:14 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.info Jul 09 03:04:14 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:14 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.999s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:04:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:04:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:04:15 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.info" returned: 0 in 1.033s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.404s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:15 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-fd2aac02-e3eb-443c-9468-f2d2960e3b8d tempest-SnapshotMetadataTestJSON-1378003522 None] Create snapshot completed successfully Jul 09 03:04:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Acquiring lock "cinder-96b49239-2d8c-4908-9b6e-b34f2ef566d7-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "cinder-96b49239-2d8c-4908-9b6e-b34f2ef566d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Acquiring lock "cinder-quobyte-50b9db67-1759-42c6-a125-695c29f7bd03" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "cinder-quobyte-50b9db67-1759-42c6-a125-695c29f7bd03" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Acquiring lock "cinder-quobyte-96b49239-2d8c-4908-9b6e-b34f2ef566d7" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "cinder-quobyte-96b49239-2d8c-4908-9b6e-b34f2ef566d7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Deleting offline snapshot 96b49239-2d8c-4908-9b6e-b34f2ef566d7 of volume 50b9db67-1759-42c6-a125-695c29f7bd03 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:04:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] snapshot_file for this snap is: volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:04:17 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1a14f1-d73a-4f8d-93e4-1ed0301fa54c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:18 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 Jul 09 03:04:18 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:19 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7" returned: 0 in 1.399s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50b9db67-1759-42c6-a125-695c29f7bd03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:04:19 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a328f6-8eee-4f76-b775-2db9a07e9c9a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-34c88327-a379-457a-9026-d5663ed2a3db req-fab5a7b9-c0e5-4cc7-803f-4da917c62283 tempest-ServerActionsTestOtherA-1797345585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-34c88327-a379-457a-9026-d5663ed2a3db req-fab5a7b9-c0e5-4cc7-803f-4da917c62283 tempest-ServerActionsTestOtherA-1797345585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:19 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc72f81-57d3-4611-970f-3778bdccf781]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-34c88327-a379-457a-9026-d5663ed2a3db req-fab5a7b9-c0e5-4cc7-803f-4da917c62283 tempest-ServerActionsTestOtherA-1797345585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:19 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 Jul 09 03:04:19 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:19 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e Jul 09 03:04:19 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:20 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-34c88327-a379-457a-9026-d5663ed2a3db req-fab5a7b9-c0e5-4cc7-803f-4da917c62283 tempest-ServerActionsTestOtherA-1797345585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e" returned: 0 in 1.073s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-34c88327-a379-457a-9026-d5663ed2a3db req-fab5a7b9-c0e5-4cc7-803f-4da917c62283 tempest-ServerActionsTestOtherA-1797345585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.094s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:04:20 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Flow 'volume_create_manager' (6fd84ed9-1b25-4496-8dd6-586758bf1b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86120eec-f7cf-45b5-8e92-8e8ae95b0eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03" returned: 0 in 1.221s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:20 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 Jul 09 03:04:20 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86120eec-f7cf-45b5-8e92-8e8ae95b0eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1676441207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed3dc64-1b91-4eec-aef5-e3166fcd9140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='969110778f2649929abe2841992cf1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:20Z,use_quota=True,user_id='397ad5918fa74006bb3443a5b97aa4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6d2189-1048-44a4-a661-42f9b2a3b600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6d2189-1048-44a4-a661-42f9b2a3b600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea86171-507d-49be-84a9-a54def357a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea86171-507d-49be-84a9-a54def357a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed3dc64-1b91-4eec-aef5-e3166fcd9140', 'volume_name': 'volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7741580c-cbb5-4a8a-a45b-4ab30bbf273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7741580c-cbb5-4a8a-a45b-4ab30bbf273b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a95da5-1ba9-43ef-b896-0a1030b21da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:20 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Volume aed3dc64-1b91-4eec-aef5-e3166fcd9140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140', 'volume_size': 1} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1676441207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed3dc64-1b91-4eec-aef5-e3166fcd9140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='969110778f2649929abe2841992cf1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:20Z,use_quota=True,user_id='397ad5918fa74006bb3443a5b97aa4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Creating volume aed3dc64-1b91-4eec-aef5-e3166fcd9140 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:20 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:20 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 1073741824 Jul 09 03:04:20 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-34c88327-a379-457a-9026-d5663ed2a3db req-fab5a7b9-c0e5-4cc7-803f-4da917c62283 tempest-ServerActionsTestOtherA-1797345585 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-724163d5-03c4-4696-9de7-5abeb62e6f9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a953d9e1-4fc6-4d86-b782-5e97a8f9879d', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:04:20 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-34c88327-a379-457a-9026-d5663ed2a3db req-fab5a7b9-c0e5-4cc7-803f-4da917c62283 tempest-ServerActionsTestOtherA-1797345585 None] attachment_update completed successfully. Jul 09 03:04:21 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7" returned: 0 in 0.864s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:21 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7 Jul 09 03:04:21 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:21 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 1073741824" returned: 0 in 1.145s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:21 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 Jul 09 03:04:21 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:22 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03.96b49239-2d8c-4908-9b6e-b34f2ef566d7" returned: 0 in 0.730s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "cinder-quobyte-96b49239-2d8c-4908-9b6e-b34f2ef566d7" released by "_delete_snapshot" :: held 4.416s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "cinder-quobyte-50b9db67-1759-42c6-a125-695c29f7bd03" released by "delete_snapshot" :: held 4.453s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Created reservations ['f96fd6e1-d302-4bf9-82e5-88b7d8e96b9a', '4cec71a4-6c35-4552-a4f5-883ac8596837', '384bc954-e362-466d-a51f-6c6ffd93670f', 'bc5c3bad-0f73-4ea7-b9c3-1bc244273091'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Delete snapshot completed successfully. Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a1e78f5c-8f47-404c-8736-951b73bf09b8 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "cinder-96b49239-2d8c-4908-9b6e-b34f2ef566d7-delete_snapshot" released by "delete_snapshot" :: held 4.615s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:22 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140" returned: 0 in 0.716s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a95da5-1ba9-43ef-b896-0a1030b21da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cca210c-da7e-4932-a57d-cca561f3f972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Acquiring lock "cinder-50b9db67-1759-42c6-a125-695c29f7bd03-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "cinder-50b9db67-1759-42c6-a125-695c29f7bd03-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:22 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Volume volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 (aed3dc64-1b91-4eec-aef5-e3166fcd9140): created successfully Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cca210c-da7e-4932-a57d-cca561f3f972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Flow 'volume_create_manager' (6fd84ed9-1b25-4496-8dd6-586758bf1b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f6677000-b173-4486-a079-3ff01317129c tempest-TaggedAttachmentsTest-1557831145 None] Created volume successfully. Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Acquiring lock "cinder-quobyte-50b9db67-1759-42c6-a125-695c29f7bd03" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "cinder-quobyte-50b9db67-1759-42c6-a125-695c29f7bd03" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[676bee6f-49f8-4038-9cb7-8243612f85cc]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:22 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 Jul 09 03:04:22 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:23 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03" returned: 0 in 0.842s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:23 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03 Jul 09 03:04:23 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:24 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-50b9db67-1759-42c6-a125-695c29f7bd03" returned: 0 in 0.654s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "cinder-quobyte-50b9db67-1759-42c6-a125-695c29f7bd03" released by "delete_volume" :: held 1.552s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:24 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Created reservations ['15799ce8-ae6d-471e-88df-a9fc95b65b94', 'f45b9498-6a33-40f2-864f-318de0c0eb1a', '3de21bb7-426d-494d-98bd-f2ad4f296d4c', 'c518c578-aab0-4081-86ee-e959ef777716'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:24 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:04:24 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:25 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.731s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:25 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:25 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Deleted volume successfully. Jul 09 03:04:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e1a4ce20-fd8e-447b-a27b-1e5bb3f82277 tempest-SnapshotMetadataTestJSON-1378003522 None] Lock "cinder-50b9db67-1759-42c6-a125-695c29f7bd03-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:28 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-d5c3ae10-0856-410e-a039-7b69ef747111 req-fcaac784-7042-4be4-a8f7-828e9a6868ac tempest-ServerActionsTestOtherA-1797345585 None] Terminate volume connection completed successfully. Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-d5c3ae10-0856-410e-a039-7b69ef747111 req-fcaac784-7042-4be4-a8f7-828e9a6868ac tempest-ServerActionsTestOtherA-1797345585 None] Deleting attachment a953d9e1-4fc6-4d86-b782-5e97a8f9879d. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Flow 'volume_create_manager' (285cc668-ca38-43dc-9ef8-20798f0e99a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2618ddc5-89c2-448d-b1c7-f4d108a438c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2618ddc5-89c2-448d-b1c7-f4d108a438c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1323984665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2296c0-ffa8-489f-b5fa-20be2cd292a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0281e7d86dcb466c962f4a2457534070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:28Z,use_quota=True,user_id='6ecc0b1b774447b495cdeeb46f37c6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d095155-fd51-4eed-a616-9dad1b8cadd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d095155-fd51-4eed-a616-9dad1b8cadd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639a2c26-fa60-41bf-86cb-b24d29f5cd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639a2c26-fa60-41bf-86cb-b24d29f5cd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2296c0-ffa8-489f-b5fa-20be2cd292a8', 'volume_name': 'volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9efe6b-e802-4d16-bccc-a156cc574054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9efe6b-e802-4d16-bccc-a156cc574054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc0447f-40b7-4d60-ae44-17a247964799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:28 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Volume 8b2296c0-ffa8-489f-b5fa-20be2cd292a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8', 'volume_size': 1} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1323984665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2296c0-ffa8-489f-b5fa-20be2cd292a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0281e7d86dcb466c962f4a2457534070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:28Z,use_quota=True,user_id='6ecc0b1b774447b495cdeeb46f37c6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Creating volume 8b2296c0-ffa8-489f-b5fa-20be2cd292a8 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:28 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:04:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:28 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 1073741824 Jul 09 03:04:28 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:29 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 1073741824" returned: 0 in 0.896s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:29 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 Jul 09 03:04:29 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:30 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" returned: 0 in 0.915s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc0447f-40b7-4d60-ae44-17a247964799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a21e80-f532-43d7-aef6-db15d9a4eecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:30 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Volume volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 (8b2296c0-ffa8-489f-b5fa-20be2cd292a8): created successfully Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a21e80-f532-43d7-aef6-db15d9a4eecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Flow 'volume_create_manager' (285cc668-ca38-43dc-9ef8-20798f0e99a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:30 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1a88a19a-3e06-428b-8731-aeaad7f7efbb tempest-VolumesDeleteCascade-1353616874 None] Created volume successfully. Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] Creating offline snapshot 50c209d7-94ff-42b3-ad05-6a3f79403181 of volume 8b2296c0-ffa8-489f-b5fa-20be2cd292a8 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8e3cca-17bd-4d9a-a1e1-8d5f5503a23d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-d5c3ae10-0856-410e-a039-7b69ef747111 req-06540920-1fff-4b23-b037-6776965d81f1 tempest-ServerActionsTestOtherA-1797345585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:31 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 Jul 09 03:04:31 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:31 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" returned: 0 in 0.912s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:31 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 1G Jul 09 03:04:31 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:32 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 1G" returned: 0 in 0.866s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:32 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 Jul 09 03:04:32 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:33 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181" returned: 0 in 0.793s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:33 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 is being set with open permissions: ugo+rw Jul 09 03:04:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:33 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 Jul 09 03:04:33 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:33 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Flow 'volume_create_manager' (2cff6331-ffcc-4383-9afe-fb9c2a8c8c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3b1e18-af87-444f-8575-00213604b4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3b1e18-af87-444f-8575-00213604b4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-937297751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be9da47-1d06-4651-9a2c-2a64cd965490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab3c4112ba242c9bfdfff3ce93c5320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:34Z,use_quota=True,user_id='21a446a0837b4a62b66e4526c68dfc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded7edb5-5df0-4419-a53b-30006477f30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded7edb5-5df0-4419-a53b-30006477f30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8a515f-5f0f-45eb-a345-4098afe7c912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8a515f-5f0f-45eb-a345-4098afe7c912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6be9da47-1d06-4651-9a2c-2a64cd965490', 'volume_name': 'volume-6be9da47-1d06-4651-9a2c-2a64cd965490', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd3a4ce-22cb-45cb-a04a-2a8c41a3982a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd3a4ce-22cb-45cb-a04a-2a8c41a3982a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a330d9f3-54f2-4c05-94f1-a80920df31f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:34 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Volume 6be9da47-1d06-4651-9a2c-2a64cd965490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6be9da47-1d06-4651-9a2c-2a64cd965490', 'volume_size': 1} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:34 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181" returned: 0 in 0.805s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:34 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.info Jul 09 03:04:34 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:34 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.info" returned: 0 in 0.658s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:34 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.info is being set with open permissions: ugo+rw Jul 09 03:04:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:35 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.info Jul 09 03:04:35 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:35 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.info" returned: 0 in 0.627s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.755s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-d5c3ae10-0856-410e-a039-7b69ef747111 req-06540920-1fff-4b23-b037-6776965d81f1 tempest-ServerActionsTestOtherA-1797345585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.681s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:35 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b783b8a9-1549-4ae4-8667-5662ceba891d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-d5c3ae10-0856-410e-a039-7b69ef747111 req-06540920-1fff-4b23-b037-6776965d81f1 tempest-ServerActionsTestOtherA-1797345585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:35 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-cc827f25-1afe-4716-88e3-1c7288fa3a1f tempest-VolumesDeleteCascade-1353616874 None] Create snapshot completed successfully Jul 09 03:04:35 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e Jul 09 03:04:35 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:36 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-d5c3ae10-0856-410e-a039-7b69ef747111 req-06540920-1fff-4b23-b037-6776965d81f1 tempest-ServerActionsTestOtherA-1797345585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e" returned: 0 in 0.755s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-d5c3ae10-0856-410e-a039-7b69ef747111 req-06540920-1fff-4b23-b037-6776965d81f1 tempest-ServerActionsTestOtherA-1797345585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.773s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.326s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-937297751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be9da47-1d06-4651-9a2c-2a64cd965490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab3c4112ba242c9bfdfff3ce93c5320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:34Z,use_quota=True,user_id='21a446a0837b4a62b66e4526c68dfc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Creating volume 6be9da47-1d06-4651-9a2c-2a64cd965490 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:36 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:36 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490 1073741824 Jul 09 03:04:36 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-d5c3ae10-0856-410e-a039-7b69ef747111 req-06540920-1fff-4b23-b037-6776965d81f1 tempest-ServerActionsTestOtherA-1797345585 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-724163d5-03c4-4696-9de7-5abeb62e6f9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7914b761-6117-4c7b-9739-5eac0ccb5c19', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:04:36 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-d5c3ae10-0856-410e-a039-7b69ef747111 req-06540920-1fff-4b23-b037-6776965d81f1 tempest-ServerActionsTestOtherA-1797345585 None] attachment_update completed successfully. Jul 09 03:04:37 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490 1073741824" returned: 0 in 0.840s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:37 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490 Jul 09 03:04:37 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490" returned: 0 in 0.659s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:04:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.658s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:37 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] Creating offline snapshot 12701b95-98c1-4a94-a314-7b21539f3554 of volume 8b2296c0-ffa8-489f-b5fa-20be2cd292a8 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:04:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a330d9f3-54f2-4c05-94f1-a80920df31f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be9da47-1d06-4651-9a2c-2a64cd965490', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191d21b7-8be6-448f-ae6b-9ac3014b9ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:38 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcd578a-321d-46f3-b63e-34143ed29406]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:38 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Volume volume-6be9da47-1d06-4651-9a2c-2a64cd965490 (6be9da47-1d06-4651-9a2c-2a64cd965490): created successfully Jul 09 03:04:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191d21b7-8be6-448f-ae6b-9ac3014b9ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Flow 'volume_create_manager' (2cff6331-ffcc-4383-9afe-fb9c2a8c8c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bffa64e8-3716-493f-a11b-a304ff69f120 tempest-AttachVolumeNegativeTest-1162607623 None] Created volume successfully. Jul 09 03:04:38 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 Jul 09 03:04:38 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:39 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181" returned: 0 in 0.956s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:04:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:39 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 1G Jul 09 03:04:39 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:39 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 1G" returned: 0 in 0.864s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:39 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 Jul 09 03:04:39 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:40 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554" returned: 0 in 0.891s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:40 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 is being set with open permissions: ugo+rw Jul 09 03:04:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:40 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 Jul 09 03:04:40 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:41 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554" returned: 0 in 0.833s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.770s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:41 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6622df08-9b91-4e93-abbf-739c4a985bbf tempest-VolumesDeleteCascade-1353616874 None] Create snapshot completed successfully Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-2ecf6f93-8422-4bdc-bea6-bd21459e72e2 req-5082c61b-6e05-480b-9e92-fcbff363abf1 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-2ecf6f93-8422-4bdc-bea6-bd21459e72e2 req-5082c61b-6e05-480b-9e92-fcbff363abf1 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d84145-2e48-43d0-9d39-0696bf27fe65]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-2ecf6f93-8422-4bdc-bea6-bd21459e72e2 req-5082c61b-6e05-480b-9e92-fcbff363abf1 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:42 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490 Jul 09 03:04:42 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-8b2296c0-ffa8-489f-b5fa-20be2cd292a8-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-8b2296c0-ffa8-489f-b5fa-20be2cd292a8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Performing cascade delete. {{(pid=87216) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-12701b95-98c1-4a94-a314-7b21539f3554-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-12701b95-98c1-4a94-a314-7b21539f3554-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-quobyte-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-quobyte-12701b95-98c1-4a94-a314-7b21539f3554" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-12701b95-98c1-4a94-a314-7b21539f3554" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Deleting offline snapshot 12701b95-98c1-4a94-a314-7b21539f3554 of volume 8b2296c0-ffa8-489f-b5fa-20be2cd292a8 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:04:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] snapshot_file for this snap is: volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:04:43 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6845b083-353d-4ea3-b6c5-ac5183d4f5a1]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:43 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 Jul 09 03:04:43 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:43 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-2ecf6f93-8422-4bdc-bea6-bd21459e72e2 req-5082c61b-6e05-480b-9e92-fcbff363abf1 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490" returned: 0 in 1.258s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-2ecf6f93-8422-4bdc-bea6-bd21459e72e2 req-5082c61b-6e05-480b-9e92-fcbff363abf1 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.285s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-2ecf6f93-8422-4bdc-bea6-bd21459e72e2 req-5082c61b-6e05-480b-9e92-fcbff363abf1 tempest-AttachVolumeNegativeTest-1162607623 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-6be9da47-1d06-4651-9a2c-2a64cd965490', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f52857ea-c7e8-4958-ba0c-433af1e8834e', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:04:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-2ecf6f93-8422-4bdc-bea6-bd21459e72e2 req-5082c61b-6e05-480b-9e92-fcbff363abf1 tempest-AttachVolumeNegativeTest-1162607623 None] attachment_update completed successfully. Jul 09 03:04:44 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554" returned: 0 in 1.128s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:04:44 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f23daa-dffb-4e5a-ad3d-b0eac0b15417]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:44 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 Jul 09 03:04:44 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:45 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181" returned: 0 in 1.390s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:04:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:45 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 Jul 09 03:04:45 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:46 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554" returned: 0 in 1.385s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:47 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554 Jul 09 03:04:47 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:47 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.12701b95-98c1-4a94-a314-7b21539f3554" returned: 0 in 0.972s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-12701b95-98c1-4a94-a314-7b21539f3554" released by "_delete_snapshot" :: held 5.072s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" released by "delete_snapshot" :: held 5.129s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Created reservations ['49cacced-af8f-4a5a-b1b8-cc4c73bb1ec7', 'f2b05ea9-42f8-4c69-8eef-e198a0341bc5', '88e8671f-21a0-4037-93f9-4c95749e0ade', '5c1a9205-23da-4f52-affa-27db98ed4a2e'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Delete snapshot completed successfully. Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-12701b95-98c1-4a94-a314-7b21539f3554-delete_snapshot" released by "delete_snapshot" :: held 5.375s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-50c209d7-94ff-42b3-ad05-6a3f79403181-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-50c209d7-94ff-42b3-ad05-6a3f79403181-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-quobyte-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-quobyte-50c209d7-94ff-42b3-ad05-6a3f79403181" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-50c209d7-94ff-42b3-ad05-6a3f79403181" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Deleting offline snapshot 50c209d7-94ff-42b3-ad05-6a3f79403181 of volume 8b2296c0-ffa8-489f-b5fa-20be2cd292a8 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] snapshot_file for this snap is: volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f14368a-341e-4471-be99-e944b848d514]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:48 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 Jul 09 03:04:48 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:49 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181" returned: 0 in 0.938s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:04:49 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f175218-b2a2-4e70-9746-8fbd193b8481]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:49 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 Jul 09 03:04:49 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:50 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" returned: 0 in 0.797s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:50 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 Jul 09 03:04:50 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-af160809-ec4e-40ac-a6fa-ae679f1281cb req-5fb17f3b-f73c-45b0-b12c-a24b5450fdc2 tempest-AttachVolumeNegativeTest-1162607623 None] Terminate volume connection completed successfully. Jul 09 03:04:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-af160809-ec4e-40ac-a6fa-ae679f1281cb req-5fb17f3b-f73c-45b0-b12c-a24b5450fdc2 tempest-AttachVolumeNegativeTest-1162607623 None] Deleting attachment f52857ea-c7e8-4958-ba0c-433af1e8834e. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:04:50 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181" returned: 0 in 0.816s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:50 devstack sudo[91443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181 Jul 09 03:04:50 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:51 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8.50c209d7-94ff-42b3-ad05-6a3f79403181" returned: 0 in 0.678s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-50c209d7-94ff-42b3-ad05-6a3f79403181" released by "_delete_snapshot" :: held 3.334s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" released by "delete_snapshot" :: held 3.368s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:51 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Created reservations ['60490e2b-1768-4955-b619-733ba48c9036', 'f080a2d8-cf2a-4c55-8df2-4bba507ea5f1', 'c58bec72-e999-4543-8d4b-b0b6978a635a', '816cd02a-3695-4d5f-9372-bd20d3eda340'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:51 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Delete snapshot completed successfully. Jul 09 03:04:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-50c209d7-94ff-42b3-ad05-6a3f79403181-delete_snapshot" released by "delete_snapshot" :: held 3.563s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Snapshots deleted, issuing volume delete {{(pid=87216) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 03:04:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-quobyte-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" acquired by "delete_volume" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:51 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[487b09fc-fc58-4868-97e6-f030ba063ffd]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:51 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 Jul 09 03:04:51 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:52 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" returned: 0 in 1.041s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:52 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8 Jul 09 03:04:52 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:53 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" returned: 0 in 0.886s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-8b2296c0-ffa8-489f-b5fa-20be2cd292a8" released by "delete_volume" :: held 2.009s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:53 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Created reservations ['c31533cb-b2fd-4a25-b4fc-864713a69750', 'b5f7add9-9cf5-4d4c-a603-087357beaf9f', '6574133d-8d05-4a59-b0d3-0506e0f3f647', 'b522623c-ecfb-48e1-8d81-c16ce53aa5e3'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:54 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:04:54 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:55 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.332s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:55 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Deleted volume successfully. Jul 09 03:04:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a0dda58-ca2e-4a81-8286-198400d821a6 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-8b2296c0-ffa8-489f-b5fa-20be2cd292a8-delete_volume" released by "delete_volume" :: held 12.816s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Flow 'volume_create_manager' (e0c59359-184f-427b-ba4c-cf94f7ed0c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66df2559-3d4f-4614-aa3f-d8d8121f1345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66df2559-3d4f-4614-aa3f-d8d8121f1345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-443126465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64c3a4a-dc49-44df-a9fe-d0362a0a3023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0281e7d86dcb466c962f4a2457534070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:56Z,use_quota=True,user_id='6ecc0b1b774447b495cdeeb46f37c6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2910c3a8-0b95-4929-a16b-9ec2e3b63155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2910c3a8-0b95-4929-a16b-9ec2e3b63155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe009b8-a516-4d88-b498-3bebab4f7c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe009b8-a516-4d88-b498-3bebab4f7c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f64c3a4a-dc49-44df-a9fe-d0362a0a3023', 'volume_name': 'volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09bb995-588f-44ef-98c5-19432928f2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09bb995-588f-44ef-98c5-19432928f2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d65324-9f3b-4d9c-9728-816668236370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:56 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Volume f64c3a4a-dc49-44df-a9fe-d0362a0a3023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023', 'volume_size': 1} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-443126465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64c3a4a-dc49-44df-a9fe-d0362a0a3023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0281e7d86dcb466c962f4a2457534070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:56Z,use_quota=True,user_id='6ecc0b1b774447b495cdeeb46f37c6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Creating volume f64c3a4a-dc49-44df-a9fe-d0362a0a3023 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:56 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:04:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:56 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 1073741824 Jul 09 03:04:56 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:57 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 1073741824" returned: 0 in 1.066s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:57 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 Jul 09 03:04:57 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:58 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" returned: 0 in 0.781s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:04:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d65324-9f3b-4d9c-9728-816668236370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd0811b-d3ea-490f-a055-3cb51efb052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:58 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Volume volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 (f64c3a4a-dc49-44df-a9fe-d0362a0a3023): created successfully Jul 09 03:04:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd0811b-d3ea-490f-a055-3cb51efb052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Flow 'volume_create_manager' (e0c59359-184f-427b-ba4c-cf94f7ed0c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:58 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-39da8015-88d1-4fd9-bd78-03ba43728381 tempest-VolumesDeleteCascade-1353616874 None] Created volume successfully. Jul 09 03:04:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] Creating offline snapshot 8be56d84-0053-4d49-8d31-72dd1f441f45 of volume f64c3a4a-dc49-44df-a9fe-d0362a0a3023 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:04:59 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab09f60a-2310-45b0-a6f4-bdd259efbb8f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:59 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 Jul 09 03:04:59 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:00 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" returned: 0 in 0.737s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:00 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 1G Jul 09 03:05:00 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:01 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 1G" returned: 0 in 0.816s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:01 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 Jul 09 03:05:01 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:01 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45" returned: 0 in 0.750s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:01 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 is being set with open permissions: ugo+rw Jul 09 03:05:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:02 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 Jul 09 03:05:02 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:02 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45" returned: 0 in 0.671s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:02 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.info Jul 09 03:05:02 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:03 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.info" returned: 0 in 0.648s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:03 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.info is being set with open permissions: ugo+rw Jul 09 03:05:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:03 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.info Jul 09 03:05:03 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:03 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.info" returned: 0 in 0.615s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.320s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:04 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-36571000-88b2-4a58-af17-1de6258975b2 tempest-VolumesDeleteCascade-1353616874 None] Create snapshot completed successfully Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Flow 'volume_create_manager' (ea53eef1-b200-4d6a-b56e-86dd47cd94a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8b77de-e20f-4eb2-8821-2867869c8962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8b77de-e20f-4eb2-8821-2867869c8962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-900687433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc26663-24b1-4e27-804a-858996913443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0281e7d86dcb466c962f4a2457534070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8be56d84-0053-4d49-8d31-72dd1f441f45,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:06Z,use_quota=True,user_id='6ecc0b1b774447b495cdeeb46f37c6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04453ec8-dc7d-4394-b770-7cdb52ff4f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04453ec8-dc7d-4394-b770-7cdb52ff4f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7a9133-2081-44e6-81a6-203edeae45e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7a9133-2081-44e6-81a6-203edeae45e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9dc26663-24b1-4e27-804a-858996913443', 'volume_name': 'volume-9dc26663-24b1-4e27-804a-858996913443', 'volume_size': 1, 'snapshot_id': '8be56d84-0053-4d49-8d31-72dd1f441f45'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da48cb4-6588-4031-b6d2-9433a778f7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da48cb4-6588-4031-b6d2-9433a778f7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48735216-2a3a-4c8a-a000-7bc4018dc346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:05 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Volume 9dc26663-24b1-4e27-804a-858996913443: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9dc26663-24b1-4e27-804a-858996913443', 'volume_size': 1, 'snapshot_id': '8be56d84-0053-4d49-8d31-72dd1f441f45'} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-quobyte-8be56d84-0053-4d49-8d31-72dd1f441f45-9dc26663-24b1-4e27-804a-858996913443" by "_create_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-8be56d84-0053-4d49-8d31-72dd1f441f45-9dc26663-24b1-4e27-804a-858996913443" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Creating volume 9dc26663-24b1-4e27-804a-858996913443 from snapshot 8be56d84-0053-4d49-8d31-72dd1f441f45 {{(pid=87216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-quobyte-9dc26663-24b1-4e27-804a-858996913443" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-9dc26663-24b1-4e27-804a-858996913443" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] snapshot: 8be56d84-0053-4d49-8d31-72dd1f441f45, volume: 9dc26663-24b1-4e27-804a-858996913443, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c825329-f783-4012-9345-49db2a3e5b49]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:05 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 Jul 09 03:05:05 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:06 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45" returned: 0 in 0.838s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:05:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:05:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:05:06 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2514b51c-d6ba-4aa9-b9dc-1ebb048e24ad]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:06 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 Jul 09 03:05:06 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:07 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" returned: 0 in 0.844s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:07 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443 not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:05:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:07 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443 Jul 09 03:05:07 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:08 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=55,cinder:DELETE=10,cinder:SELECT=67,cinder:INSERT=13 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:05:08 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=61,cinder:SELECT=72,cinder:INSERT=15,cinder:DELETE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:05:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-3e3e2e65-1a53-459a-b6ae-f9b41473dc21 req-14878498-d861-4311-aee2-cd6e5dedd77f tempest-ServerActionsTestOtherA-1797345585 None] Terminate volume connection completed successfully. Jul 09 03:05:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-3e3e2e65-1a53-459a-b6ae-f9b41473dc21 req-14878498-d861-4311-aee2-cd6e5dedd77f tempest-ServerActionsTestOtherA-1797345585 None] Deleting attachment 7914b761-6117-4c7b-9739-5eac0ccb5c19. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:05:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:05:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:13 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443" returned: 0 in 6.295s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:13 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f751803-bb80-41e0-b0a7-d44f5bb7b5f9]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:13 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:05:13 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:13 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 Jul 09 03:05:13 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:14 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.904s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:05:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:05:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:05:14 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" returned: 0 in 1.132s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:14 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:05:14 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Converted 1024.00 MB image at 162.63 MB/s Jul 09 03:05:14 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443 is being set with open permissions: ugo+rw Jul 09 03:05:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:14 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443 Jul 09 03:05:14 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:15 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443" returned: 0 in 0.639s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-9dc26663-24b1-4e27-804a-858996913443" released by "_copy_volume_from_snapshot" :: held 9.849s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-8be56d84-0053-4d49-8d31-72dd1f441f45-9dc26663-24b1-4e27-804a-858996913443" released by "_create_volume_from_snapshot" :: held 9.885s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.902s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48735216-2a3a-4c8a-a000-7bc4018dc346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc26663-24b1-4e27-804a-858996913443', 'volume_size': 1, 'snapshot_id': '8be56d84-0053-4d49-8d31-72dd1f441f45'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a42df9-6b25-4cfd-9222-3cd326ea64d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:15 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Volume volume-9dc26663-24b1-4e27-804a-858996913443 (9dc26663-24b1-4e27-804a-858996913443): created successfully Jul 09 03:05:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a42df9-6b25-4cfd-9222-3cd326ea64d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Flow 'volume_create_manager' (ea53eef1-b200-4d6a-b56e-86dd47cd94a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:15 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4b0a79d2-1139-43df-b50e-181797c17931 tempest-VolumesDeleteCascade-1353616874 None] Created volume successfully. Jul 09 03:05:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-f64c3a4a-dc49-44df-a9fe-d0362a0a3023-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-f64c3a4a-dc49-44df-a9fe-d0362a0a3023-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Performing cascade delete. {{(pid=87216) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 03:05:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-8be56d84-0053-4d49-8d31-72dd1f441f45-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-8be56d84-0053-4d49-8d31-72dd1f441f45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-quobyte-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-quobyte-8be56d84-0053-4d49-8d31-72dd1f441f45" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-8be56d84-0053-4d49-8d31-72dd1f441f45" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Deleting offline snapshot 8be56d84-0053-4d49-8d31-72dd1f441f45 of volume f64c3a4a-dc49-44df-a9fe-d0362a0a3023 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:05:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] snapshot_file for this snap is: volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:05:17 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[58768732-2f86-4bfb-bfee-4d03ec9d36d2]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:17 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 Jul 09 03:05:17 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45" returned: 0 in 1.041s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:05:18 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:18 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b288399-f66b-46d3-b505-69265a525fa7]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:18 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 Jul 09 03:05:18 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:19 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" returned: 0 in 1.159s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:19 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 Jul 09 03:05:19 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:20 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45" returned: 0 in 0.899s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:20 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45 Jul 09 03:05:20 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:20 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023.8be56d84-0053-4d49-8d31-72dd1f441f45" returned: 0 in 0.712s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-8be56d84-0053-4d49-8d31-72dd1f441f45" released by "_delete_snapshot" :: held 3.983s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" released by "delete_snapshot" :: held 4.011s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:21 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Created reservations ['11603c5a-5440-41c0-a04b-a91827dc43a7', '88dfa57b-e5d6-4d1c-bb06-4f58e2522a4f', '5ed6e6f0-1e0a-4f43-8a74-2869a13bc543', '11807973-0376-4367-9cda-609b2b38a779'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:21 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Delete snapshot completed successfully. Jul 09 03:05:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-8be56d84-0053-4d49-8d31-72dd1f441f45-delete_snapshot" released by "delete_snapshot" :: held 4.200s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Snapshots deleted, issuing volume delete {{(pid=87216) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 03:05:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-quobyte-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" acquired by "delete_volume" :: waited 0.032s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:21 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4550f72-13bf-48b1-8550-7a78c2e2c382]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:21 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 Jul 09 03:05:21 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:22 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" returned: 0 in 1.163s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:22 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023 Jul 09 03:05:22 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:23 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" returned: 0 in 1.020s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-f64c3a4a-dc49-44df-a9fe-d0362a0a3023" released by "delete_volume" :: held 2.278s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Acquiring lock "cinder-724163d5-03c4-4696-9de7-5abeb62e6f9e-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Lock "cinder-724163d5-03c4-4696-9de7-5abeb62e6f9e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Created reservations ['12f149c7-ea5c-46fb-8809-da47a78332aa', '8f8d60e9-9538-4b18-8c83-ec4619515022', '2ab9ca04-ba51-4ebb-85bd-676f939d3903', 'ff8e6b94-4ef4-4aea-a05c-fff2d3201a13'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Acquiring lock "cinder-quobyte-724163d5-03c4-4696-9de7-5abeb62e6f9e" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Lock "cinder-quobyte-724163d5-03c4-4696-9de7-5abeb62e6f9e" acquired by "delete_volume" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5022251b-001c-4769-9c23-483cf2d79b50]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:23 devstack sudo[91931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:05:23 devstack sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:23 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e Jul 09 03:05:23 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:24 devstack sudo[91931]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.803s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:24 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:24 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Deleted volume successfully. Jul 09 03:05:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-708cc586-da6b-48a5-a8b4-41a0ebfa90ef tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-f64c3a4a-dc49-44df-a9fe-d0362a0a3023-delete_volume" released by "delete_volume" :: held 7.701s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-9dc26663-24b1-4e27-804a-858996913443-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-9dc26663-24b1-4e27-804a-858996913443-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "cinder-quobyte-9dc26663-24b1-4e27-804a-858996913443" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:24 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-9dc26663-24b1-4e27-804a-858996913443" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e" returned: 0 in 1.347s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:25 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ced996e-aa6c-495a-9b40-342b32326256]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:25 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e Jul 09 03:05:25 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:25 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443 Jul 09 03:05:25 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-7202b549-4adf-4078-91b2-008520d2d94b req-ef1a39ec-ea5f-4dab-acb6-b5c9f9ba358a tempest-TaggedAttachmentsTest-1557831145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-7202b549-4adf-4078-91b2-008520d2d94b req-ef1a39ec-ea5f-4dab-acb6-b5c9f9ba358a tempest-TaggedAttachmentsTest-1557831145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:25 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[606c67f8-26ca-4ad2-8a3d-d7caa5bd00ce]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-7202b549-4adf-4078-91b2-008520d2d94b req-ef1a39ec-ea5f-4dab-acb6-b5c9f9ba358a tempest-TaggedAttachmentsTest-1557831145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:25 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 Jul 09 03:05:25 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:25 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-724163d5-03c4-4696-9de7-5abeb62e6f9e" returned: 0 in 0.972s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Lock "cinder-quobyte-724163d5-03c4-4696-9de7-5abeb62e6f9e" released by "delete_volume" :: held 2.382s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Created reservations ['27bc1694-b4e6-481f-864c-fe17b68a0dbb', 'fb7e4a99-4d22-4780-a1ab-0b8ee6c45014', '93b310e6-123f-4a69-8190-4c9ba9676643', '07865de6-63c0-4d5b-8ec2-0786a86d6a00'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:26 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443" returned: 0 in 1.170s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:26 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443 Jul 09 03:05:26 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:26 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:05:26 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:26 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-7202b549-4adf-4078-91b2-008520d2d94b req-ef1a39ec-ea5f-4dab-acb6-b5c9f9ba358a tempest-TaggedAttachmentsTest-1557831145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140" returned: 0 in 1.090s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-7202b549-4adf-4078-91b2-008520d2d94b req-ef1a39ec-ea5f-4dab-acb6-b5c9f9ba358a tempest-TaggedAttachmentsTest-1557831145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.112s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-7202b549-4adf-4078-91b2-008520d2d94b req-ef1a39ec-ea5f-4dab-acb6-b5c9f9ba358a tempest-TaggedAttachmentsTest-1557831145 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6329c20-7cb3-4d62-99db-aca24a9f7858', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:05:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-7202b549-4adf-4078-91b2-008520d2d94b req-ef1a39ec-ea5f-4dab-acb6-b5c9f9ba358a tempest-TaggedAttachmentsTest-1557831145 None] attachment_update completed successfully. Jul 09 03:05:27 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9dc26663-24b1-4e27-804a-858996913443" returned: 0 in 1.305s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-quobyte-9dc26663-24b1-4e27-804a-858996913443" released by "delete_volume" :: held 2.599s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:27 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.270s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Created reservations ['96d72bc3-8585-4bd3-b2ef-33e607e10cf0', '625e5977-e357-407b-9ef7-ef6560090f1b', 'e1bf4afb-b54c-4fb5-9e1d-8f694969ba1a', '980a1fff-18a1-4004-b321-2609535fbc60'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Deleted volume successfully. Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e8c9400e-f29a-44e7-ab07-71dcdae01367 tempest-ServerActionsTestOtherA-1797345585 None] Lock "cinder-724163d5-03c4-4696-9de7-5abeb62e6f9e-delete_volume" released by "delete_volume" :: held 4.273s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:27 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:05:27 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:28 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.749s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:28 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:28 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Deleted volume successfully. Jul 09 03:05:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-77dd003a-c3a0-47b0-90d0-6e9049d86d16 tempest-VolumesDeleteCascade-1353616874 None] Lock "cinder-9dc26663-24b1-4e27-804a-858996913443-delete_volume" released by "delete_volume" :: held 3.741s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Flow 'volume_create_manager' (f96aa0eb-f263-4b69-9069-7eb92df86aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bb7d9f-4cfa-4be6-8774-f038c7914e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bb7d9f-4cfa-4be6-8774-f038c7914e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2051573478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42c8de4-c1e3-4e90-8083-6f1ad1f1b768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841f657a1a2b4846944b266affec5e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:33Z,use_quota=True,user_id='4d82efb4194b41a0b1779841aee6cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05eddc7-b873-4766-9426-ec6b9cd6289b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05eddc7-b873-4766-9426-ec6b9cd6289b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b0b1aa-cb9b-48ca-a16f-94b74bda16d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b0b1aa-cb9b-48ca-a16f-94b74bda16d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e42c8de4-c1e3-4e90-8083-6f1ad1f1b768', 'volume_name': 'volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238e201f-4ea1-4bce-b51a-15b5fa93b3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238e201f-4ea1-4bce-b51a-15b5fa93b3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867da161-0b9b-4a68-9a25-3808ad24627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:32 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Volume e42c8de4-c1e3-4e90-8083-6f1ad1f1b768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768', 'volume_size': 1} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2051573478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42c8de4-c1e3-4e90-8083-6f1ad1f1b768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841f657a1a2b4846944b266affec5e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:33Z,use_quota=True,user_id='4d82efb4194b41a0b1779841aee6cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Creating volume e42c8de4-c1e3-4e90-8083-6f1ad1f1b768 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:32 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:05:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:32 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768 1073741824 Jul 09 03:05:32 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:33 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768 1073741824" returned: 0 in 1.055s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:33 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768 Jul 09 03:05:33 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-6a9a488b-0bde-49df-a497-28ee2d21c2f5 req-ae45cbf8-99f3-4edc-80f9-9ae9a6f21fd2 tempest-TaggedAttachmentsTest-1557831145 None] Terminate volume connection completed successfully. Jul 09 03:05:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-6a9a488b-0bde-49df-a497-28ee2d21c2f5 req-ae45cbf8-99f3-4edc-80f9-9ae9a6f21fd2 tempest-TaggedAttachmentsTest-1557831145 None] Deleting attachment c6329c20-7cb3-4d62-99db-aca24a9f7858. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:05:34 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768" returned: 0 in 0.828s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:05:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867da161-0b9b-4a68-9a25-3808ad24627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cc94a4-9cfc-4117-b2ad-8dccbbb68a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:34 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Volume volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768 (e42c8de4-c1e3-4e90-8083-6f1ad1f1b768): created successfully Jul 09 03:05:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cc94a4-9cfc-4117-b2ad-8dccbbb68a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Flow 'volume_create_manager' (f96aa0eb-f263-4b69-9069-7eb92df86aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a90d23a8-4006-4b1c-9e00-a0c38413ab9b tempest-VolumesMetadataTest-2112847738 None] Created volume successfully. Jul 09 03:05:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Acquiring lock "cinder-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Lock "cinder-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Acquiring lock "cinder-quobyte-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Lock "cinder-quobyte-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:36 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[53192023-5846-466d-bd54-71775b6f3138]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:36 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768 Jul 09 03:05:36 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:37 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768" returned: 0 in 1.069s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:37 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768 Jul 09 03:05:37 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:38 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768" returned: 0 in 0.733s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Lock "cinder-quobyte-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768" released by "delete_volume" :: held 1.856s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:38 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Created reservations ['d72f4353-2d0d-400e-9c2b-ca904244befb', 'da0dff1d-a725-48c6-98b8-8f36f60c3550', 'e9d2451f-1192-43d3-8679-82a6b483135d', '32df45b7-9c95-4d15-8089-cab1dcfd5115'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:38 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:05:38 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:39 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.863s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:39 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:39 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Deleted volume successfully. Jul 09 03:05:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a492ae5-a5ac-45dd-85ec-671467ab5abb tempest-VolumesMetadataTest-2112847738 None] Lock "cinder-e42c8de4-c1e3-4e90-8083-6f1ad1f1b768-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Flow 'volume_create_manager' (94ae337a-cea0-4764-afba-3cf7ec291d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b14d517-82cd-4a4a-a756-65ce95a6ce9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b14d517-82cd-4a4a-a756-65ce95a6ce9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-58296766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89757a0d-b5e5-4d2f-9c19-ef32dac5d873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e16b9e587f4cff824a58f843031380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:45Z,use_quota=True,user_id='180241b4608e4d56b23c7cb865f5c1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225d9e12-7fec-463d-90a4-a1bde9a87ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225d9e12-7fec-463d-90a4-a1bde9a87ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ae2663-d2f9-4c12-8a94-ed847eddb94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ae2663-d2f9-4c12-8a94-ed847eddb94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89757a0d-b5e5-4d2f-9c19-ef32dac5d873', 'volume_name': 'volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87458e88-a970-4497-95f7-ae47c436b647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87458e88-a970-4497-95f7-ae47c436b647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f613ea1-0ba5-4ec3-8126-be1a30921b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:44 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Volume 89757a0d-b5e5-4d2f-9c19-ef32dac5d873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873', 'volume_size': 1} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-58296766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89757a0d-b5e5-4d2f-9c19-ef32dac5d873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e16b9e587f4cff824a58f843031380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:45Z,use_quota=True,user_id='180241b4608e4d56b23c7cb865f5c1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Creating volume 89757a0d-b5e5-4d2f-9c19-ef32dac5d873 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:44 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:05:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:44 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873 1073741824 Jul 09 03:05:44 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Flow 'volume_create_manager' (7d589413-92ab-4c01-91e5-aa305fa76164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6352009-740c-4728-a502-d8edb4e33e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6352009-740c-4728-a502-d8edb4e33e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1812357120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fd16d5-b4ef-4aa4-bba6-b39b411892a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab3c4112ba242c9bfdfff3ce93c5320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:46Z,use_quota=True,user_id='21a446a0837b4a62b66e4526c68dfc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb033dec-c163-4197-ab3f-d9513ac3c2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb033dec-c163-4197-ab3f-d9513ac3c2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f317f659-0354-4d15-b74c-1fdb198934e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f317f659-0354-4d15-b74c-1fdb198934e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7fd16d5-b4ef-4aa4-bba6-b39b411892a3', 'volume_name': 'volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce25b13-5ebc-4938-ace3-084e4973b576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce25b13-5ebc-4938-ace3-084e4973b576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c99ee3a-b89e-4060-82a9-21896f4ae0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:46 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Volume a7fd16d5-b4ef-4aa4-bba6-b39b411892a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3', 'volume_size': 1} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:46 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873 1073741824" returned: 0 in 1.461s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:46 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873 Jul 09 03:05:46 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:47 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873" returned: 0 in 0.774s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.974s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1812357120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fd16d5-b4ef-4aa4-bba6-b39b411892a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab3c4112ba242c9bfdfff3ce93c5320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:46Z,use_quota=True,user_id='21a446a0837b4a62b66e4526c68dfc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Creating volume a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:47 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:47 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 1073741824 Jul 09 03:05:47 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f613ea1-0ba5-4ec3-8126-be1a30921b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b088eb-d1ef-4779-9d24-d77f04ce8c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:47 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Volume volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873 (89757a0d-b5e5-4d2f-9c19-ef32dac5d873): created successfully Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b088eb-d1ef-4779-9d24-d77f04ce8c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Flow 'volume_create_manager' (94ae337a-cea0-4764-afba-3cf7ec291d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:47 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0f1a39a9-8ada-4480-92b3-62e842e6a74a tempest-VolumesTransfersTest-504802562 None] Created volume successfully. Jul 09 03:05:48 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 1073741824" returned: 0 in 0.884s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:48 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 Jul 09 03:05:48 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6bc44b94-e076-45f0-83c1-06b0cf29655a tempest-VolumesTransfersTest-631921474 None] Transfer volume completed successfully. Jul 09 03:05:48 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3" returned: 0 in 0.797s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:05:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c99ee3a-b89e-4060-82a9-21896f4ae0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40646428-b717-413e-9257-1541c89e3bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:48 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Volume volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 (a7fd16d5-b4ef-4aa4-bba6-b39b411892a3): created successfully Jul 09 03:05:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40646428-b717-413e-9257-1541c89e3bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Flow 'volume_create_manager' (7d589413-92ab-4c01-91e5-aa305fa76164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-ab800181-b8a4-414c-b782-faace734f4de tempest-AttachVolumeNegativeTest-1162607623 None] Created volume successfully. Jul 09 03:05:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Acquiring lock "cinder-89757a0d-b5e5-4d2f-9c19-ef32dac5d873-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Lock "cinder-89757a0d-b5e5-4d2f-9c19-ef32dac5d873-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Acquiring lock "cinder-quobyte-89757a0d-b5e5-4d2f-9c19-ef32dac5d873" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Lock "cinder-quobyte-89757a0d-b5e5-4d2f-9c19-ef32dac5d873" acquired by "delete_volume" :: waited 0.040s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:49 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f829a-1502-4327-b10e-dd6ea6215879]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:49 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873 Jul 09 03:05:49 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:50 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873" returned: 0 in 0.891s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:50 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873 Jul 09 03:05:50 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:51 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89757a0d-b5e5-4d2f-9c19-ef32dac5d873" returned: 0 in 0.796s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Lock "cinder-quobyte-89757a0d-b5e5-4d2f-9c19-ef32dac5d873" released by "delete_volume" :: held 1.737s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:51 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Created reservations ['63da054c-c341-4e76-887b-22a7424ad815', 'a765152a-c658-4339-9e54-50654d819ae2', '30718d28-21cb-4ad0-87c0-f2f6be1e8e2e', '86f9a734-ac85-420f-9e42-3e64fab2cbe3'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:51 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:05:51 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-c1d81424-c876-4599-abf2-40db49b48078 req-42756187-6ef2-441a-9492-67f80b91e293 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-c1d81424-c876-4599-abf2-40db49b48078 req-42756187-6ef2-441a-9492-67f80b91e293 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:52 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19bb34b-ffe2-4bab-b930-952b7acbccfa]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-c1d81424-c876-4599-abf2-40db49b48078 req-42756187-6ef2-441a-9492-67f80b91e293 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:52 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 Jul 09 03:05:52 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:52 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.034s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:52 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:52 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Deleted volume successfully. Jul 09 03:05:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c389dfca-43e0-46b2-8bdb-16b20b98f810 tempest-VolumesTransfersTest-181451413 None] Lock "cinder-89757a0d-b5e5-4d2f-9c19-ef32dac5d873-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Flow 'volume_create_manager' (a21d0432-c213-4ff3-8b05-c21de6fad1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432e129b-03ef-4951-b20e-d47f686230de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432e129b-03ef-4951-b20e-d47f686230de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2108283106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832c0d03-e738-4fbd-84e7-6c10f1a388da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e16b9e587f4cff824a58f843031380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:53Z,use_quota=True,user_id='180241b4608e4d56b23c7cb865f5c1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26f9813-0e55-4056-bd71-c0db99a2d5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26f9813-0e55-4056-bd71-c0db99a2d5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc164212-bad8-4894-90e7-d4dc93b384ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc164212-bad8-4894-90e7-d4dc93b384ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832c0d03-e738-4fbd-84e7-6c10f1a388da', 'volume_name': 'volume-832c0d03-e738-4fbd-84e7-6c10f1a388da', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2265ca06-f13c-40de-9b18-2155d6519b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2265ca06-f13c-40de-9b18-2155d6519b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed251a6-d735-49cf-af0c-02a12e6aefa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:53 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Volume 832c0d03-e738-4fbd-84e7-6c10f1a388da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832c0d03-e738-4fbd-84e7-6c10f1a388da', 'volume_size': 1} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:53 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-c1d81424-c876-4599-abf2-40db49b48078 req-42756187-6ef2-441a-9492-67f80b91e293 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3" returned: 0 in 1.206s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-c1d81424-c876-4599-abf2-40db49b48078 req-42756187-6ef2-441a-9492-67f80b91e293 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.237s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2108283106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832c0d03-e738-4fbd-84e7-6c10f1a388da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e16b9e587f4cff824a58f843031380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:53Z,use_quota=True,user_id='180241b4608e4d56b23c7cb865f5c1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Creating volume 832c0d03-e738-4fbd-84e7-6c10f1a388da {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:53 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:53 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da 1073741824 Jul 09 03:05:53 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-c1d81424-c876-4599-abf2-40db49b48078 req-42756187-6ef2-441a-9492-67f80b91e293 tempest-AttachVolumeNegativeTest-1162607623 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '050a87a0-8581-4afa-ae34-669b8dfa12bd', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:05:53 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-c1d81424-c876-4599-abf2-40db49b48078 req-42756187-6ef2-441a-9492-67f80b91e293 tempest-AttachVolumeNegativeTest-1162607623 None] attachment_update completed successfully. Jul 09 03:05:54 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da 1073741824" returned: 0 in 1.252s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:55 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da Jul 09 03:05:55 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Acquiring lock "cinder-aed3dc64-1b91-4eec-aef5-e3166fcd9140-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Lock "cinder-aed3dc64-1b91-4eec-aef5-e3166fcd9140-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Acquiring lock "cinder-quobyte-aed3dc64-1b91-4eec-aef5-e3166fcd9140" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Lock "cinder-quobyte-aed3dc64-1b91-4eec-aef5-e3166fcd9140" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:55 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1ecba1-ff2e-4d95-8db3-f09c802a014c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:55 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 Jul 09 03:05:55 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:55 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da" returned: 0 in 0.965s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:05:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed251a6-d735-49cf-af0c-02a12e6aefa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832c0d03-e738-4fbd-84e7-6c10f1a388da', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3405cf5b-9b17-4efe-9ab0-c2ed6740f0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:56 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Volume volume-832c0d03-e738-4fbd-84e7-6c10f1a388da (832c0d03-e738-4fbd-84e7-6c10f1a388da): created successfully Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3405cf5b-9b17-4efe-9ab0-c2ed6740f0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Flow 'volume_create_manager' (a21d0432-c213-4ff3-8b05-c21de6fad1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:56 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4b5f1012-f815-4a56-ab53-1b1892b95f0f tempest-VolumesTransfersTest-504802562 None] Created volume successfully. Jul 09 03:05:56 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140" returned: 0 in 0.824s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:56 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140 Jul 09 03:05:56 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Acquiring lock "cinder-832c0d03-e738-4fbd-84e7-6c10f1a388da-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Lock "cinder-832c0d03-e738-4fbd-84e7-6c10f1a388da-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Acquiring lock "cinder-quobyte-832c0d03-e738-4fbd-84e7-6c10f1a388da" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Lock "cinder-quobyte-832c0d03-e738-4fbd-84e7-6c10f1a388da" acquired by "delete_volume" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[708fef05-f5af-4a14-afbe-02aa9d4cf643]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:56 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da Jul 09 03:05:56 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:57 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aed3dc64-1b91-4eec-aef5-e3166fcd9140" returned: 0 in 0.737s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Lock "cinder-quobyte-aed3dc64-1b91-4eec-aef5-e3166fcd9140" released by "delete_volume" :: held 1.670s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:57 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Created reservations ['b5ba86e0-83c8-46c4-ae4d-22375f0f62aa', 'a95af726-b33f-418e-becb-c887267f8f0b', '480422e0-8844-4470-b993-b3c33c8fd993', 'd2db4b3b-5f5c-48e5-bca7-92f33ceb52d9'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:57 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:05:57 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:57 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da" returned: 0 in 1.151s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:58 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da Jul 09 03:05:58 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:58 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.889s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:58 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:58 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Deleted volume successfully. Jul 09 03:05:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-24cdf900-0485-477b-9d94-30d8399ae7d7 tempest-TaggedAttachmentsTest-1557831145 None] Lock "cinder-aed3dc64-1b91-4eec-aef5-e3166fcd9140-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:58 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-832c0d03-e738-4fbd-84e7-6c10f1a388da" returned: 0 in 0.964s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Lock "cinder-quobyte-832c0d03-e738-4fbd-84e7-6c10f1a388da" released by "delete_volume" :: held 2.177s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:59 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Created reservations ['0348c73f-3be3-4967-863a-9fb1dff98bcd', '9880558e-1f36-4dd9-8ed6-0d962ca046de', '6e9e061b-9dc9-45c0-a3c1-43373297ec2c', 'cf428af9-77bd-4817-9b72-eea70b8e1967'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:59 devstack sudo[93034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:05:59 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:59 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-b427b76a-db3d-417c-a342-2e1d1c6b60e9 req-c8419687-1dec-40aa-9456-92f6d827ef1a tempest-AttachVolumeNegativeTest-1162607623 None] Terminate volume connection completed successfully. Jul 09 03:05:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-b427b76a-db3d-417c-a342-2e1d1c6b60e9 req-c8419687-1dec-40aa-9456-92f6d827ef1a tempest-AttachVolumeNegativeTest-1162607623 None] Deleting attachment 050a87a0-8581-4afa-ae34-669b8dfa12bd. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:06:00 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.916s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:00 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:00 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Deleted volume successfully. Jul 09 03:06:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-650eba5b-c5a9-4ca2-9704-b6d4626ace98 tempest-VolumesTransfersTest-181451413 None] Lock "cinder-832c0d03-e738-4fbd-84e7-6c10f1a388da-delete_volume" released by "delete_volume" :: held 3.581s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=66,cinder:UPDATE=79,cinder:DELETE=4,cinder:INSERT=17 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=78,cinder:SELECT=60,cinder:INSERT=19,cinder:DELETE=8 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Flow 'volume_create_manager' (d673989f-e844-4e1e-9377-52ab997db315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210a96b2-a1e5-45aa-85c1-eee157c77eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210a96b2-a1e5-45aa-85c1-eee157c77eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1222177287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dad3aee-1f2e-46fd-aa16-53e68c53839a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81c0b5cb754496aa475379f834ee6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:09Z,use_quota=True,user_id='8fad758e638c4f6c84c84ce3a497462c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fd33fa-1ca6-43eb-bff8-edfc2aa0ba55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fd33fa-1ca6-43eb-bff8-edfc2aa0ba55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371b0443-c22a-4b22-9a02-a4ac05a8460b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371b0443-c22a-4b22-9a02-a4ac05a8460b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dad3aee-1f2e-46fd-aa16-53e68c53839a', 'volume_name': 'volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a', 'volume_size': 2}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392b8422-1cb9-4902-beac-606edd5d8ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392b8422-1cb9-4902-beac-606edd5d8ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c18af2d-6cfe-43ef-8ec5-9ae6704c629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:09 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Volume 6dad3aee-1f2e-46fd-aa16-53e68c53839a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a', 'volume_size': 2} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1222177287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dad3aee-1f2e-46fd-aa16-53e68c53839a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81c0b5cb754496aa475379f834ee6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:09Z,use_quota=True,user_id='8fad758e638c4f6c84c84ce3a497462c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Creating volume 6dad3aee-1f2e-46fd-aa16-53e68c53839a {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:09 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:06:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a 2147483648 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:09 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a 2147483648 Jul 09 03:06:09 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:10 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a 2147483648" returned: 0 in 1.122s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:10 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a Jul 09 03:06:10 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:11 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a" returned: 0 in 0.797s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c18af2d-6cfe-43ef-8ec5-9ae6704c629d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a', 'volume_size': 2}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6d4fcf-a436-4898-88da-e501056c94d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:11 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Volume volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a (6dad3aee-1f2e-46fd-aa16-53e68c53839a): created successfully Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6d4fcf-a436-4898-88da-e501056c94d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Flow 'volume_create_manager' (d673989f-e844-4e1e-9377-52ab997db315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:11 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f63ceec7-f601-490d-9299-7cc9d6b021f5 tempest-VolumesCloneNegativeTest-594975711 None] Created volume successfully. Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "cinder-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "cinder-quobyte-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-quobyte-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd741a60-22b7-4cca-bcdb-15457c63bceb]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:12 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 Jul 09 03:06:12 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Acquiring lock "cinder-6dad3aee-1f2e-46fd-aa16-53e68c53839a-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Lock "cinder-6dad3aee-1f2e-46fd-aa16-53e68c53839a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Acquiring lock "cinder-quobyte-6dad3aee-1f2e-46fd-aa16-53e68c53839a" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Lock "cinder-quobyte-6dad3aee-1f2e-46fd-aa16-53e68c53839a" acquired by "delete_volume" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:12 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b47788-b3df-461c-8b34-3b9846c4cf58]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:13 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3" returned: 0 in 1.198s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:13 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a Jul 09 03:06:13 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:13 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3 Jul 09 03:06:13 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:06:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:13 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:06:13 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:14 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a" returned: 0 in 1.335s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:14 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a Jul 09 03:06:14 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:14 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3" returned: 0 in 1.250s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-quobyte-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3" released by "delete_volume" :: held 2.521s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:14 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Created reservations ['e87a8c77-22bf-4993-8c15-61c274cb57dc', 'c6ba043e-e884-4de5-b856-414ec5ea0719', '43248181-776e-4d0d-b45e-82149aa86675', 'd964d653-431e-4319-a198-ea94408f96df'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:14 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:14 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:14 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:06:14 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:15 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.460s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:15 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:15 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:06:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:06:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:06:15 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6dad3aee-1f2e-46fd-aa16-53e68c53839a" returned: 0 in 1.470s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Lock "cinder-quobyte-6dad3aee-1f2e-46fd-aa16-53e68c53839a" released by "delete_volume" :: held 2.891s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:15 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Created reservations ['145d2256-221a-4e21-ba5b-03548e0f0200', '2647bb3c-97bd-467d-82cd-7edde89f8006', '3181463d-abb2-4bcd-9994-2ebddd0e5628', 'b71085af-30fc-4ff6-b4d1-687ef952ee2f'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:16 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:06:16 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:16 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.470s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:16 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Deleted volume successfully. Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-388b5602-9cf4-4e0a-a536-8497938adb49 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-a7fd16d5-b4ef-4aa4-bba6-b39b411892a3-delete_volume" released by "delete_volume" :: held 4.523s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "cinder-6be9da47-1d06-4651-9a2c-2a64cd965490-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-6be9da47-1d06-4651-9a2c-2a64cd965490-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "cinder-quobyte-6be9da47-1d06-4651-9a2c-2a64cd965490" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-quobyte-6be9da47-1d06-4651-9a2c-2a64cd965490" acquired by "delete_volume" :: waited 0.055s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1846eb9-5010-41a9-9efa-49795879f134]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:16 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490 Jul 09 03:06:16 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:17 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.746s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:17 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:17 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Deleted volume successfully. Jul 09 03:06:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6e376220-69ce-47ba-ac4c-4d3e7027acc8 tempest-VolumesCloneNegativeTest-594975711 None] Lock "cinder-6dad3aee-1f2e-46fd-aa16-53e68c53839a-delete_volume" released by "delete_volume" :: held 5.066s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:18 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490" returned: 0 in 1.511s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:18 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490 Jul 09 03:06:18 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:19 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6be9da47-1d06-4651-9a2c-2a64cd965490" returned: 0 in 1.440s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-quobyte-6be9da47-1d06-4651-9a2c-2a64cd965490" released by "delete_volume" :: held 3.068s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:19 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Created reservations ['9553530a-2902-41da-b315-bbfea8ab0e83', '1d2487cf-9f73-4e67-b9dd-2c52d72c445a', 'b11f3f4e-db46-4622-a467-bcd95146e4a9', 'fdd95a56-d5b6-4999-a235-6b5764e7ec63'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:19 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:06:19 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "cinder-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "cinder-quobyte-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-quobyte-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed" acquired by "delete_volume" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:21 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8804b1c-f8ed-429c-af05-5e72158b5d21]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:21 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed Jul 09 03:06:21 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:21 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.973s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:21 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:21 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Deleted volume successfully. Jul 09 03:06:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cd9cd8e1-bbc3-4eae-9843-b5f07c33f853 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-6be9da47-1d06-4651-9a2c-2a64cd965490-delete_volume" released by "delete_volume" :: held 5.565s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:22 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed" returned: 0 in 1.757s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:22 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed Jul 09 03:06:22 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:24 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed" returned: 0 in 1.291s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-quobyte-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed" released by "delete_volume" :: held 3.171s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:24 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Created reservations ['8c97fef6-dcd2-433b-b008-4ed437a8adc8', 'a90c585b-1dfd-4c1f-9825-150a02ca6381', '35827711-e7e5-4f5f-906a-f98b48a0d75b', '6854535e-10a7-4064-bcc0-ec5d8ad58705'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:24 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:06:24 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:25 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.232s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:25 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:25 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Deleted volume successfully. Jul 09 03:06:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cda03abb-a6bc-4321-895a-70befc0ae667 tempest-AttachVolumeNegativeTest-1162607623 None] Lock "cinder-2e6535df-d67d-48ed-8a99-dfbfbdc9b9ed-delete_volume" released by "delete_volume" :: held 5.009s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:25 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Flow 'volume_create_manager' (c33b01d8-b988-4eb8-8a7f-328f873e0696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d691d20d-cd1d-46a5-9217-27ebad9f8a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d691d20d-cd1d-46a5-9217-27ebad9f8a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2098159642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae06fcca-7c6a-434b-8171-dbca072250b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fa9c1f60294033a48691b4f656ad0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:26Z,use_quota=True,user_id='c43b89bc9317436b9b79b77255186a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330ac893-7de7-4478-bbe9-b14b7725263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330ac893-7de7-4478-bbe9-b14b7725263b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33dc470b-bd0c-42cc-810a-0ef450e94c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:26 devstack cinder-volume[87216]: DEBUG cinder.image.glance [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Creating Keystone auth plugin from conf {{(pid=87216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:06:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33dc470b-bd0c-42cc-810a-0ef450e94c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae06fcca-7c6a-434b-8171-dbca072250b0', 'volume_name': 'volume-ae06fcca-7c6a-434b-8171-dbca072250b0', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf77cc3-a8df-4541-87eb-b023993b79db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf77cc3-a8df-4541-87eb-b023993b79db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638c9186-acf5-485c-8fbf-d2ac2e41e139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:26 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Volume ae06fcca-7c6a-434b-8171-dbca072250b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae06fcca-7c6a-434b-8171-dbca072250b0', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 03:06:26 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Trying to clone ae06fcca-7c6a-434b-8171-dbca072250b0 from image ea6ec930-eba2-423b-9437-18da29841701 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]). {{(pid=87216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:06:27 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:06:27 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Image download 20.69 MB at 20.69 MB/s Jul 09 03:06:27 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f799c594-c1b2-4406-8fce-af2c53bd6bb5]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:27 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD Jul 09 03:06:27 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:28 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD" returned: 0 in 1.327s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:28 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Temporary image ea6ec930-eba2-423b-9437-18da29841701 is fetched for user c43b89bc9317436b9b79b77255186a8f. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:06:28 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7a27e9-84dd-4d77-9794-40ac1964e0b0]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:28 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD Jul 09 03:06:28 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:29 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD" returned: 0 in 1.225s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2098159642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae06fcca-7c6a-434b-8171-dbca072250b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fa9c1f60294033a48691b4f656ad0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:26Z,use_quota=True,user_id='c43b89bc9317436b9b79b77255186a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Creating volume ae06fcca-7c6a-434b-8171-dbca072250b0 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:29 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:06:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:30 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 1073741824 Jul 09 03:06:30 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:31 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 1073741824" returned: 0 in 1.125s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:31 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 Jul 09 03:06:31 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:31 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0" returned: 0 in 0.829s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:32 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Attempting download of ea6ec930-eba2-423b-9437-18da29841701 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}])) to volume ae06fcca-7c6a-434b-8171-dbca072250b0. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:06:32 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4caebe-29ec-4353-a35c-80df7b2d6c25]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_28px6vmk {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:32 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_28px6vmk Jul 09 03:06:32 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:33 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_28px6vmk" returned: 0 in 0.983s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_28px6vmk {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:33 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_28px6vmk Jul 09 03:06:33 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:34 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_28px6vmk" returned: 1 in 1.315s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_28px6vmk' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:34 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5a3718-beb9-4688-bd8d-3590d54f07f2]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:34 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD Jul 09 03:06:34 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:35 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD" returned: 0 in 1.129s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:35 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] ea6ec930-eba2-423b-9437-18da29841701 was qcow2, converting to raw {{(pid=87216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:06:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:35 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 Jul 09 03:06:35 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Flow 'volume_create_manager' (ecbe352f-e3b8-4a65-947e-367e54da6de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae1cd5d-1417-4cd6-8c00-ac985e229cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae1cd5d-1417-4cd6-8c00-ac985e229cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1584336779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76401a87-4d65-4bed-bbc2-86ac1be930ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d28dbd636b4a7589fb89d0406767d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:36Z,use_quota=True,user_id='ecf727544ed84807bd742f841db2b41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598f78b2-b365-4391-844c-20c3fb2523eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598f78b2-b365-4391-844c-20c3fb2523eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09db9997-cd45-40b9-9d7c-5a8705c61166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09db9997-cd45-40b9-9d7c-5a8705c61166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76401a87-4d65-4bed-bbc2-86ac1be930ad', 'volume_name': 'volume-76401a87-4d65-4bed-bbc2-86ac1be930ad', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c0f2b7-338c-4616-9715-c67bff3aaa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c0f2b7-338c-4616-9715-c67bff3aaa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd2061a-f6c7-4006-9bbe-46b9ee884d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:36 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Volume 76401a87-4d65-4bed-bbc2-86ac1be930ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76401a87-4d65-4bed-bbc2-86ac1be930ad', 'volume_size': 1} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1584336779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76401a87-4d65-4bed-bbc2-86ac1be930ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d28dbd636b4a7589fb89d0406767d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:36Z,use_quota=True,user_id='ecf727544ed84807bd742f841db2b41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Creating volume 76401a87-4d65-4bed-bbc2-86ac1be930ad {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:36 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:06:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:36 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad 1073741824 Jul 09 03:06:36 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:38 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad 1073741824" returned: 0 in 2.036s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:38 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad Jul 09 03:06:38 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:38 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0" returned: 0 in 3.411s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:38 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_yme2lba5devstack@QuobyteHD, size 112.00 MB, duration 3.41 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:06:38 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Converted 112.00 MB image at 32.82 MB/s Jul 09 03:06:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:39 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 1G Jul 09 03:06:39 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:39 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 1G" returned: 0 in 0.803s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:39 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[11385f14-917b-46b4-bc47-3088e3527c75]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:39 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad" returned: 0 in 1.190s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] <== create_volume: return (3300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.309s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd2061a-f6c7-4006-9bbe-46b9ee884d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76401a87-4d65-4bed-bbc2-86ac1be930ad', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d78a05-52aa-45d2-92e0-a9157546bced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:39 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Volume volume-76401a87-4d65-4bed-bbc2-86ac1be930ad (76401a87-4d65-4bed-bbc2-86ac1be930ad): created successfully Jul 09 03:06:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d78a05-52aa-45d2-92e0-a9157546bced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:39 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 Jul 09 03:06:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Flow 'volume_create_manager' (ecbe352f-e3b8-4a65-947e-367e54da6de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:39 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:39 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3f8b5fd3-72b0-40d9-a632-d6610f353c3e tempest-ServerRescueNegativeTestJSON-509666162 None] Created volume successfully. Jul 09 03:06:41 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0" returned: 0 in 1.207s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Flow 'volume_create_manager' (f24837fd-acbe-4830-8207-031be264778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c43820-cc2f-4441-acec-624a594ff763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c43820-cc2f-4441-acec-624a594ff763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1696761334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c7a6aa-f4bb-426d-a374-3c1f2ccdc513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07f886317a64c14a8e76efc0a74474b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:41Z,use_quota=True,user_id='c56969fa76b8445298ab20094dfec03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5485b945-fca1-4b16-a447-db4da2f2037c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5485b945-fca1-4b16-a447-db4da2f2037c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:41 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf31acc-65d2-4da6-bee1-183416e11c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:41 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf31acc-65d2-4da6-bee1-183416e11c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c7a6aa-f4bb-426d-a374-3c1f2ccdc513', 'volume_name': 'volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d72ead-e5c7-411e-b690-f73a389729b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d72ead-e5c7-411e-b690-f73a389729b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b949c97-07ff-40d6-8b7b-68cf6c56bebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:41 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Volume 65c7a6aa-f4bb-426d-a374-3c1f2ccdc513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513', 'volume_size': 1} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1696761334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c7a6aa-f4bb-426d-a374-3c1f2ccdc513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07f886317a64c14a8e76efc0a74474b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:41Z,use_quota=True,user_id='c56969fa76b8445298ab20094dfec03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Creating volume 65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:41 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:06:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:41 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 1073741824 Jul 09 03:06:41 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:42 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0" returned: 1 in 1.880s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:42 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Downloaded image ea6ec930-eba2-423b-9437-18da29841701 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}])) to volume ae06fcca-7c6a-434b-8171-dbca072250b0 successfully. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:06:42 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Temporary image ea6ec930-eba2-423b-9437-18da29841701 for user c43b89bc9317436b9b79b77255186a8f is deleted. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:06:42 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Marking volume ae06fcca-7c6a-434b-8171-dbca072250b0 as bootable. {{(pid=87216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:06:42 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Copying metadata from image ea6ec930-eba2-423b-9437-18da29841701 to ae06fcca-7c6a-434b-8171-dbca072250b0. {{(pid=87216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:06:42 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Creating volume glance metadata for volume ae06fcca-7c6a-434b-8171-dbca072250b0 backed by image ea6ec930-eba2-423b-9437-18da29841701 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:06:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638c9186-acf5-485c-8fbf-d2ac2e41e139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae06fcca-7c6a-434b-8171-dbca072250b0', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b638e8f5-9b70-4372-9eb1-91de1d40afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:43 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Volume volume-ae06fcca-7c6a-434b-8171-dbca072250b0 (ae06fcca-7c6a-434b-8171-dbca072250b0): created successfully Jul 09 03:06:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b638e8f5-9b70-4372-9eb1-91de1d40afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Flow 'volume_create_manager' (c33b01d8-b988-4eb8-8a7f-328f873e0696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b9937f2e-b3dc-492a-9d42-e267c2e0ca86 tempest-VolumesExtendTest-989977195 None] Created volume successfully. Jul 09 03:06:43 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 1073741824" returned: 0 in 1.867s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:43 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 Jul 09 03:06:43 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-76b6c005-f717-43ba-bb35-f7ab29e85673 tempest-VolumesExtendTest-989977195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:44 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513" returned: 0 in 0.880s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] <== create_volume: return (2865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.869s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-76b6c005-f717-43ba-bb35-f7ab29e85673 tempest-VolumesExtendTest-989977195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.658s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b949c97-07ff-40d6-8b7b-68cf6c56bebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759d6729-c416-49e7-8bc9-86ddf1dcc1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:44 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[85475fe9-95c0-4c0c-890e-2cdfa0aa76ac]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-76b6c005-f717-43ba-bb35-f7ab29e85673 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:44 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Volume volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 (65c7a6aa-f4bb-426d-a374-3c1f2ccdc513): created successfully Jul 09 03:06:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759d6729-c416-49e7-8bc9-86ddf1dcc1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Flow 'volume_create_manager' (f24837fd-acbe-4830-8207-031be264778b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:44 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-4d2386e9-cbfd-4a4f-860c-a45257da840c req-cfebe327-bdf4-4ed7-9922-ae14d2dbbab9 tempest-VolumesSnapshotsTestJSON-178855132 None] Created volume successfully. Jul 09 03:06:44 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 Jul 09 03:06:44 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:45 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-76b6c005-f717-43ba-bb35-f7ab29e85673 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0" returned: 0 in 1.188s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-76b6c005-f717-43ba-bb35-f7ab29e85673 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:45 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 Jul 09 03:06:45 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:46 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-76b6c005-f717-43ba-bb35-f7ab29e85673 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0" returned: 1 in 0.875s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-76b6c005-f717-43ba-bb35-f7ab29e85673 tempest-VolumesExtendTest-989977195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-76b6c005-f717-43ba-bb35-f7ab29e85673 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 2G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-76b6c005-f717-43ba-bb35-f7ab29e85673 tempest-VolumesExtendTest-989977195 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 2G" returned: 0 in 0.141s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-76b6c005-f717-43ba-bb35-f7ab29e85673 tempest-VolumesExtendTest-989977195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.257s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.468s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] Creating offline snapshot 4d3b50d0-5f9a-4896-aef8-38a498dab49c of volume 65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:06:46 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a29d708-44ed-46d5-99d6-982227d47437]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-76b6c005-f717-43ba-bb35-f7ab29e85673 tempest-VolumesExtendTest-989977195 None] Extend volume completed successfully. Jul 09 03:06:46 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 Jul 09 03:06:46 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Acquiring lock "cinder-ae06fcca-7c6a-434b-8171-dbca072250b0-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Lock "cinder-ae06fcca-7c6a-434b-8171-dbca072250b0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Acquiring lock "cinder-quobyte-ae06fcca-7c6a-434b-8171-dbca072250b0" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Lock "cinder-quobyte-ae06fcca-7c6a-434b-8171-dbca072250b0" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:47 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e9e0bf-4882-45a7-81a4-d6842606ecc7]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:47 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 Jul 09 03:06:47 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:47 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513" returned: 0 in 0.893s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:47 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c 1G Jul 09 03:06:47 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:48 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0" returned: 0 in 1.235s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:48 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 Jul 09 03:06:48 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:48 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c 1G" returned: 0 in 1.334s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:48 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c Jul 09 03:06:48 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:49 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0" returned: 1 in 1.036s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:49 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0 Jul 09 03:06:49 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:49 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c" returned: 0 in 1.013s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:49 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c is being set with open permissions: ugo+rw Jul 09 03:06:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:49 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c Jul 09 03:06:49 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:50 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae06fcca-7c6a-434b-8171-dbca072250b0" returned: 0 in 0.692s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:50 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Lock "cinder-quobyte-ae06fcca-7c6a-434b-8171-dbca072250b0" released by "delete_volume" :: held 3.046s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:50 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Created reservations ['52600fd9-7820-434b-ae5c-c638cf39576f', '40627204-558a-469f-883d-61c0db793fb4', 'f8bfd413-60ab-43cb-adfe-690f4c428114', 'db87fef6-2fbe-4991-8ba5-db8362ca090d'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:50 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:06:50 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:50 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c" returned: 0 in 0.766s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:50 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.info Jul 09 03:06:50 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:52 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Flow 'volume_create_manager' (54014e2b-7a47-4b44-8912-6f39a26c51d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7bf90f-055f-4154-b999-0b925f887a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.582s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7bf90f-055f-4154-b999-0b925f887a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-455411775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aca964-9c46-41ad-a165-89d0e448ec52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fa9c1f60294033a48691b4f656ad0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:52Z,use_quota=True,user_id='c43b89bc9317436b9b79b77255186a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef15d73b-2714-406b-a93a-37f27b553b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef15d73b-2714-406b-a93a-37f27b553b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71227480-5717-4830-a35b-5e752b6ee18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71227480-5717-4830-a35b-5e752b6ee18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91aca964-9c46-41ad-a165-89d0e448ec52', 'volume_name': 'volume-91aca964-9c46-41ad-a165-89d0e448ec52', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f6e786-1cc6-4ad2-afdd-50e65418ecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f6e786-1cc6-4ad2-afdd-50e65418ecbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5098c1b2-4285-4010-9137-05ca451e3acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:52 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Volume 91aca964-9c46-41ad-a165-89d0e448ec52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91aca964-9c46-41ad-a165-89d0e448ec52', 'volume_size': 1} Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:52 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Deleted volume successfully. Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a07abec-7656-4812-8f5d-11f40c7e5d0d tempest-VolumesExtendTest-989977195 None] Lock "cinder-ae06fcca-7c6a-434b-8171-dbca072250b0-delete_volume" released by "delete_volume" :: held 5.018s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:52 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.info" returned: 0 in 1.554s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:52 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.info is being set with open permissions: ugo+rw Jul 09 03:06:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:52 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.info Jul 09 03:06:52 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:53 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.info" returned: 0 in 1.309s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.055s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-455411775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aca964-9c46-41ad-a165-89d0e448ec52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fa9c1f60294033a48691b4f656ad0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:52Z,use_quota=True,user_id='c43b89bc9317436b9b79b77255186a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Creating volume 91aca964-9c46-41ad-a165-89d0e448ec52 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:53 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:06:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:53 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 1073741824 Jul 09 03:06:53 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:53 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-84ee23d2-76f7-4fff-a3dd-52e8bab739d1 req-22356c63-77d3-41c1-ad2f-13eca90140fe tempest-VolumesSnapshotsTestJSON-178855132 None] Create snapshot completed successfully Jul 09 03:06:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Acquiring lock "cinder-4d3b50d0-5f9a-4896-aef8-38a498dab49c-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "cinder-4d3b50d0-5f9a-4896-aef8-38a498dab49c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Acquiring lock "cinder-quobyte-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "cinder-quobyte-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Acquiring lock "cinder-quobyte-4d3b50d0-5f9a-4896-aef8-38a498dab49c" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "cinder-quobyte-4d3b50d0-5f9a-4896-aef8-38a498dab49c" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Deleting offline snapshot 4d3b50d0-5f9a-4896-aef8-38a498dab49c of volume 65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:06:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] snapshot_file for this snap is: volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:06:55 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b7fb32-7439-41bb-92ec-68123d234c68]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:55 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c Jul 09 03:06:55 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:56 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 1073741824" returned: 0 in 2.368s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:56 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 Jul 09 03:06:56 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:56 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c" returned: 0 in 1.451s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:06:56 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[994116e4-c351-48e6-8e58-c7776977753e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:57 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 Jul 09 03:06:57 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:57 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52" returned: 0 in 1.465s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] <== create_volume: return (3911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.921s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5098c1b2-4285-4010-9137-05ca451e3acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91aca964-9c46-41ad-a165-89d0e448ec52', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b178084-3a51-419c-9053-d320d8fedddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:57 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Volume volume-91aca964-9c46-41ad-a165-89d0e448ec52 (91aca964-9c46-41ad-a165-89d0e448ec52): created successfully Jul 09 03:06:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b178084-3a51-419c-9053-d320d8fedddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Flow 'volume_create_manager' (54014e2b-7a47-4b44-8912-6f39a26c51d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:57 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-67779479-6d8b-4aa7-843b-fb448ad667ed tempest-VolumesExtendTest-989977195 None] Created volume successfully. Jul 09 03:06:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] Creating offline snapshot fdd53f1c-a8eb-4701-b1d1-94f2225df58a of volume 91aca964-9c46-41ad-a165-89d0e448ec52 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:06:58 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513" returned: 0 in 1.651s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:58 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f4db0c-0985-429f-8a4c-5a4a1a044a31]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:58 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c Jul 09 03:06:58 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:58 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 Jul 09 03:06:58 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:59 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52" returned: 0 in 1.037s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:59 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c" returned: 0 in 1.108s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:59 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a 1G Jul 09 03:06:59 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:59 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c Jul 09 03:06:59 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:00 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513.4d3b50d0-5f9a-4896-aef8-38a498dab49c" returned: 0 in 1.231s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "cinder-quobyte-4d3b50d0-5f9a-4896-aef8-38a498dab49c" released by "_delete_snapshot" :: held 5.796s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "cinder-quobyte-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513" released by "delete_snapshot" :: held 5.896s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:01 devstack cinder-volume[87216]: DEBUG cinder.quota [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Created reservations ['cd09b3d8-2f57-4db6-9a6f-2b5dada346f2', '43ab19a7-c7c1-42db-ad7e-7ed6ce219e65', 'b11ccc8a-8416-4bd7-9a62-85470577a83e', 'cea67b68-ab36-422a-b8f3-d1e7bf16b58a'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Delete snapshot completed successfully. Jul 09 03:07:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-86b4e5f1-7a5b-434e-980e-46ed7cf33c45 req-7a0698b0-e758-439a-ac2e-46e2a336de44 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "cinder-4d3b50d0-5f9a-4896-aef8-38a498dab49c-delete_snapshot" released by "delete_snapshot" :: held 6.200s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:01 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a 1G" returned: 0 in 1.867s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91aca964-9c46-41ad-a165-89d0e448ec52 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:01 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91aca964-9c46-41ad-a165-89d0e448ec52 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a Jul 09 03:07:01 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Acquiring lock "cinder-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "cinder-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Acquiring lock "cinder-quobyte-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "cinder-quobyte-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513" acquired by "delete_volume" :: waited 0.055s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Acquiring lock "cinder-76401a87-4d65-4bed-bbc2-86ac1be930ad-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:02 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[049c44bb-3ab6-46f4-a130-1695868efec8]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Lock "cinder-76401a87-4d65-4bed-bbc2-86ac1be930ad-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Acquiring lock "cinder-quobyte-76401a87-4d65-4bed-bbc2-86ac1be930ad" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Lock "cinder-quobyte-76401a87-4d65-4bed-bbc2-86ac1be930ad" acquired by "delete_volume" :: waited 0.047s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:03 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db2877c-70c7-4298-aeec-628da1ba01dd]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:03 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 Jul 09 03:07:03 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:03 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91aca964-9c46-41ad-a165-89d0e448ec52 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a" returned: 0 in 2.041s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:03 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a is being set with open permissions: ugo+rw Jul 09 03:07:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:03 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad Jul 09 03:07:03 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:03 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a Jul 09 03:07:03 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:05 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513" returned: 0 in 2.601s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:05 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a" returned: 0 in 1.912s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:05 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513 Jul 09 03:07:05 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:05 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.info Jul 09 03:07:05 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:05 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad" returned: 0 in 2.762s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:05 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad Jul 09 03:07:05 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:06 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.info" returned: 0 in 1.313s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:06 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.info is being set with open permissions: ugo+rw Jul 09 03:07:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:06 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.info Jul 09 03:07:06 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:07 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513" returned: 0 in 1.774s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "cinder-quobyte-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513" released by "delete_volume" :: held 4.572s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG cinder.quota [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Created reservations ['3622bae0-e843-48e5-ad49-d29df32d6c56', '007776d8-1456-486c-85ba-231f379108c9', '21431e67-8578-4cbc-94b4-410e68c18585', '5085cea0-807b-4199-a222-9412042b10d4'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:07 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-76401a87-4d65-4bed-bbc2-86ac1be930ad" returned: 0 in 1.463s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Lock "cinder-quobyte-76401a87-4d65-4bed-bbc2-86ac1be930ad" released by "delete_volume" :: held 4.376s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:07 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:07:07 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Created reservations ['0fdf273d-4732-4bd2-b2c8-6626ee13011e', '79408d0e-7d51-4cbb-a1ce-1a12f11cc929', 'a68e8a0b-6518-4847-ac4a-8567f9e62d5e', '91028c0c-e3fb-4e63-b700-c0e70463f097'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:07 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:07:07 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:07 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.info" returned: 0 in 1.019s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.424s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:07 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a1acb63a-a1d8-49c4-bd05-22765c876f01 tempest-VolumesExtendTest-989977195 None] Create snapshot completed successfully Jul 09 03:07:08 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.267s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:08 devstack cinder-volume[87216]: DEBUG cinder.manager [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Deleted volume successfully. Jul 09 03:07:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-18b1702d-cfa2-4a14-967e-49ef2224e1af req-e939675a-1e3e-4d02-b828-3b199aafa2c1 tempest-VolumesSnapshotsTestJSON-178855132 None] Lock "cinder-65c7a6aa-f4bb-426d-a374-3c1f2ccdc513-delete_volume" released by "delete_volume" :: held 6.237s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9f88961d-3edf-4cf7-ac44-48f6790d82e3 tempest-VolumesExtendTest-989977195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9f88961d-3edf-4cf7-ac44-48f6790d82e3 tempest-VolumesExtendTest-989977195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:08 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.217s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:08 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Deleted volume successfully. Jul 09 03:07:08 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[38333408-ffb7-4521-b33c-a9252e7b8949]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f88961d-3edf-4cf7-ac44-48f6790d82e3 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e67e17e-bad1-4bdb-b67a-95f0e8953166 tempest-ServerRescueNegativeTestJSON-509666162 None] Lock "cinder-76401a87-4d65-4bed-bbc2-86ac1be930ad-delete_volume" released by "delete_volume" :: held 6.113s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:09 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 Jul 09 03:07:09 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:09 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f88961d-3edf-4cf7-ac44-48f6790d82e3 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52" returned: 0 in 1.038s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f88961d-3edf-4cf7-ac44-48f6790d82e3 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a 2G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f88961d-3edf-4cf7-ac44-48f6790d82e3 tempest-VolumesExtendTest-989977195 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a 2G" returned: 0 in 0.244s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9f88961d-3edf-4cf7-ac44-48f6790d82e3 tempest-VolumesExtendTest-989977195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.344s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:10 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=56,cinder:UPDATE=88,cinder:INSERT=29,cinder:DELETE=5 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:07:10 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=79,cinder:UPDATE=79,cinder:DELETE=9,cinder:INSERT=23 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:07:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9f88961d-3edf-4cf7-ac44-48f6790d82e3 tempest-VolumesExtendTest-989977195 None] Extend volume completed successfully. Jul 09 03:07:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Acquiring lock "cinder-fdd53f1c-a8eb-4701-b1d1-94f2225df58a-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Lock "cinder-fdd53f1c-a8eb-4701-b1d1-94f2225df58a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Acquiring lock "cinder-quobyte-91aca964-9c46-41ad-a165-89d0e448ec52" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Lock "cinder-quobyte-91aca964-9c46-41ad-a165-89d0e448ec52" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Acquiring lock "cinder-quobyte-fdd53f1c-a8eb-4701-b1d1-94f2225df58a" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Lock "cinder-quobyte-fdd53f1c-a8eb-4701-b1d1-94f2225df58a" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Deleting offline snapshot fdd53f1c-a8eb-4701-b1d1-94f2225df58a of volume 91aca964-9c46-41ad-a165-89d0e448ec52 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:07:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] snapshot_file for this snap is: volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:07:11 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2d28a7-3113-4fd7-a4f1-9a9c42e0ecf4]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:12 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a Jul 09 03:07:12 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:13 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a" returned: 0 in 1.550s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91aca964-9c46-41ad-a165-89d0e448ec52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:07:13 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6913e84d-4083-4669-83b6-f7a5c4c3a4b7]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:13 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 Jul 09 03:07:13 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:07:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:13 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:07:13 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:15 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52" returned: 0 in 1.797s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:15 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a Jul 09 03:07:15 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:16 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 2.341s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:16 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:16 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:07:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:07:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:07:16 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a" returned: 0 in 1.609s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:16 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a Jul 09 03:07:16 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c81b7385-1644-4f2b-8184-344ebd20d382 tempest-BackendsCapabilitiesAdminTestsJSON-758345872 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6497993469238, 'free_capacity_gb': 1775.6497993469238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87216) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 03:07:17 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52.fdd53f1c-a8eb-4701-b1d1-94f2225df58a" returned: 0 in 0.892s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Lock "cinder-quobyte-fdd53f1c-a8eb-4701-b1d1-94f2225df58a" released by "_delete_snapshot" :: held 6.127s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Lock "cinder-quobyte-91aca964-9c46-41ad-a165-89d0e448ec52" released by "delete_snapshot" :: held 6.178s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:17 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Created reservations ['25dc85bf-8589-4899-a622-d24d0f6bdf50', 'def3f2e7-a758-40cc-a35f-1ea23355194c', 'a134a64d-08f8-4a3a-8069-d378af6d76ee', '5bb78a8f-076c-4ba1-b7b3-cbd2abb810b1'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:18 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Delete snapshot completed successfully. Jul 09 03:07:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ecde7399-bb88-4f02-89a0-c19c3a4d52f0 tempest-VolumesExtendTest-989977195 None] Lock "cinder-fdd53f1c-a8eb-4701-b1d1-94f2225df58a-delete_snapshot" released by "delete_snapshot" :: held 6.490s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f9b2468b-e9c9-4510-9acc-6a3d8f8d0a84 tempest-BackendsCapabilitiesAdminTestsJSON-758345872 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6497993469238, 'free_capacity_gb': 1775.6497993469238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87216) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 03:07:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Acquiring lock "cinder-91aca964-9c46-41ad-a165-89d0e448ec52-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Lock "cinder-91aca964-9c46-41ad-a165-89d0e448ec52-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Acquiring lock "cinder-quobyte-91aca964-9c46-41ad-a165-89d0e448ec52" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Lock "cinder-quobyte-91aca964-9c46-41ad-a165-89d0e448ec52" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:18 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e595cbf4-c037-49f6-9abd-35c69387ff96]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:18 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 Jul 09 03:07:18 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:19 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52" returned: 0 in 0.891s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:19 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52 Jul 09 03:07:19 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:20 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-91aca964-9c46-41ad-a165-89d0e448ec52" returned: 0 in 1.063s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Lock "cinder-quobyte-91aca964-9c46-41ad-a165-89d0e448ec52" released by "delete_volume" :: held 2.040s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:20 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Created reservations ['fc2a9c5a-d02c-45f3-b90f-b5f48c1259cf', '2eb3463a-d862-4e6f-862d-6107e43d0939', '57cbfc89-d225-437e-be78-be4050d5f239', '9df9d891-abb3-4778-aec4-ecb87be1e588'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:20 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:07:20 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:21 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.978s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:21 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:21 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Deleted volume successfully. Jul 09 03:07:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-abaa903d-9241-4183-aca4-0bff34e782d1 tempest-VolumesExtendTest-989977195 None] Lock "cinder-91aca964-9c46-41ad-a165-89d0e448ec52-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (e9835d23-ad0d-4c37-bd9d-650af127b1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59d3cb4-40e9-48a5-b8e5-ce4921013c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59d3cb4-40e9-48a5-b8e5-ce4921013c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-720244302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321b2944-eb72-448e-aa6b-49ef71912cca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:25Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c72a23-1d4e-4eb4-99b2-24cb59516475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c72a23-1d4e-4eb4-99b2-24cb59516475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f79177a-9239-4ed0-b569-6b95c3fd839a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f79177a-9239-4ed0-b569-6b95c3fd839a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321b2944-eb72-448e-aa6b-49ef71912cca', 'volume_name': 'volume-321b2944-eb72-448e-aa6b-49ef71912cca', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f38d281-fa2e-491a-a059-ce2bdd620c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f38d281-fa2e-491a-a059-ce2bdd620c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fb40c9-0f45-4973-8f89-b16d9a851a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Volume 321b2944-eb72-448e-aa6b-49ef71912cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321b2944-eb72-448e-aa6b-49ef71912cca', 'volume_size': 1} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-720244302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321b2944-eb72-448e-aa6b-49ef71912cca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:25Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Creating volume 321b2944-eb72-448e-aa6b-49ef71912cca {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:25 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:25 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca 1073741824 Jul 09 03:07:25 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Flow 'volume_create_manager' (2c83cd06-2451-47a7-8344-cc2cbb06ff9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3572fbc-64c7-482b-bcb8-eb9a06a77af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3572fbc-64c7-482b-bcb8-eb9a06a77af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-275093701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b23ada0-ca78-4a61-b054-5684ae58812c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0078d0a93e4410849b1a3a3314434b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:26Z,use_quota=True,user_id='e111ca6876d64497ab0a46309a82d662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29686baa-3c5e-4322-9f53-02b878446967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29686baa-3c5e-4322-9f53-02b878446967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540e358c-c246-4bae-8275-9100a68c0ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540e358c-c246-4bae-8275-9100a68c0ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b23ada0-ca78-4a61-b054-5684ae58812c', 'volume_name': 'volume-1b23ada0-ca78-4a61-b054-5684ae58812c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211bff69-0f7c-4a0c-a241-375b5e321c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211bff69-0f7c-4a0c-a241-375b5e321c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5302e494-5639-4cf9-af5d-0e0326a6042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Volume 1b23ada0-ca78-4a61-b054-5684ae58812c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b23ada0-ca78-4a61-b054-5684ae58812c', 'volume_size': 1} Jul 09 03:07:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:26 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca 1073741824" returned: 0 in 0.949s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:26 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca Jul 09 03:07:26 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:27 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca" returned: 0 in 0.826s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.658s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-275093701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b23ada0-ca78-4a61-b054-5684ae58812c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0078d0a93e4410849b1a3a3314434b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:26Z,use_quota=True,user_id='e111ca6876d64497ab0a46309a82d662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Creating volume 1b23ada0-ca78-4a61-b054-5684ae58812c {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:27 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fb40c9-0f45-4973-8f89-b16d9a851a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321b2944-eb72-448e-aa6b-49ef71912cca', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ede710-42f0-4e6b-99d8-30681b4829fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:27 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c 1073741824 Jul 09 03:07:27 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:27 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Volume volume-321b2944-eb72-448e-aa6b-49ef71912cca (321b2944-eb72-448e-aa6b-49ef71912cca): created successfully Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ede710-42f0-4e6b-99d8-30681b4829fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (e9835d23-ad0d-4c37-bd9d-650af127b1dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-fa0c86c8-1873-46ca-9d09-9ac9d768c3ef tempest-VolumesGetTest-1542352371 None] Created volume successfully. Jul 09 03:07:28 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c 1073741824" returned: 0 in 1.169s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:28 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c Jul 09 03:07:28 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (05b7fddd-fbec-4cc7-a412-f5891362ec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8385e7-6ff0-44fe-bc5a-1b9f23cb72a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8385e7-6ff0-44fe-bc5a-1b9f23cb72a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1642998766',display_name='tempest-VolumesGetTest-Volume-1254170226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4339b84d-cfbf-4de9-89d8-e7b4a00dea0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:29Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e698dfa6-5f1e-49ab-962f-4aab4806955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e698dfa6-5f1e-49ab-962f-4aab4806955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21973f8-8257-41f0-8ed5-29093812e00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21973f8-8257-41f0-8ed5-29093812e00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4339b84d-cfbf-4de9-89d8-e7b4a00dea0d', 'volume_name': 'volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8983623a-5909-4490-8d3e-c80f1809de64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8983623a-5909-4490-8d3e-c80f1809de64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b506219e-535e-49f5-a293-78cfe899c3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:28 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Volume 4339b84d-cfbf-4de9-89d8-e7b4a00dea0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d', 'volume_size': 1} Jul 09 03:07:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:29 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c" returned: 0 in 0.795s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1642998766',display_name='tempest-VolumesGetTest-Volume-1254170226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4339b84d-cfbf-4de9-89d8-e7b4a00dea0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:29Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Creating volume 4339b84d-cfbf-4de9-89d8-e7b4a00dea0d {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:29 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5302e494-5639-4cf9-af5d-0e0326a6042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b23ada0-ca78-4a61-b054-5684ae58812c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:29 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d 1073741824 Jul 09 03:07:29 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a029200e-e7a7-4bab-b1f5-7dbc8aa06019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:29 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Volume volume-1b23ada0-ca78-4a61-b054-5684ae58812c (1b23ada0-ca78-4a61-b054-5684ae58812c): created successfully Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a029200e-e7a7-4bab-b1f5-7dbc8aa06019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Flow 'volume_create_manager' (2c83cd06-2451-47a7-8344-cc2cbb06ff9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:29 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-de295202-029f-4f09-8d20-cd92d10bd8e0 tempest-ServersNegativeTestJSON-1346533042 None] Created volume successfully. Jul 09 03:07:30 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d 1073741824" returned: 0 in 1.120s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:30 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d Jul 09 03:07:30 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:31 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d" returned: 0 in 0.871s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b506219e-535e-49f5-a293-78cfe899c3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8f5a39-3bda-40b7-80ed-3093f7132c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:31 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Volume volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d (4339b84d-cfbf-4de9-89d8-e7b4a00dea0d): created successfully Jul 09 03:07:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8f5a39-3bda-40b7-80ed-3093f7132c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (05b7fddd-fbec-4cc7-a412-f5891362ec56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:31 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f542f64c-5cd2-46cf-8602-aa6cf2526a44 tempest-VolumesGetTest-1542352371 None] Created volume successfully. Jul 09 03:07:31 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Flow 'volume_create_manager' (dee11a96-6d65-4478-ac9c-56d2005de7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c48d60-21f5-427e-b096-fc6ad17aadf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c48d60-21f5-427e-b096-fc6ad17aadf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-340891782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d1978d2-2d05-4e40-84db-5036066f0b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0078d0a93e4410849b1a3a3314434b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:32Z,use_quota=True,user_id='e111ca6876d64497ab0a46309a82d662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018cb967-f707-4939-8884-d12a23e86b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018cb967-f707-4939-8884-d12a23e86b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9a0241-717c-4b1a-a3f7-9b75077a2258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9a0241-717c-4b1a-a3f7-9b75077a2258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d1978d2-2d05-4e40-84db-5036066f0b65', 'volume_name': 'volume-5d1978d2-2d05-4e40-84db-5036066f0b65', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1756ac69-f53d-4801-abf8-306258bd8d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1756ac69-f53d-4801-abf8-306258bd8d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ad431b-1eca-4d0e-ac63-f8a2522a003e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:32 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Volume 5d1978d2-2d05-4e40-84db-5036066f0b65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d1978d2-2d05-4e40-84db-5036066f0b65', 'volume_size': 1} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-340891782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d1978d2-2d05-4e40-84db-5036066f0b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0078d0a93e4410849b1a3a3314434b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:32Z,use_quota=True,user_id='e111ca6876d64497ab0a46309a82d662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Creating volume 5d1978d2-2d05-4e40-84db-5036066f0b65 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:32 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:32 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65 1073741824 Jul 09 03:07:32 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Lock "cinder-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-quobyte-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96d2223-942b-4b5e-9c18-322021883190]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:32 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d Jul 09 03:07:32 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-fd4b0055-6528-41a1-a5b1-3c8138abd5d7 tempest-GroupsTest-94020062 None] Group tempest-Group1-29789893: creating Jul 09 03:07:33 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-fd4b0055-6528-41a1-a5b1-3c8138abd5d7 tempest-GroupsTest-94020062 None] Group tempest-Group1-29789893: created successfully Jul 09 03:07:33 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-fd4b0055-6528-41a1-a5b1-3c8138abd5d7 tempest-GroupsTest-94020062 None] Create group completed successfully. Jul 09 03:07:33 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65 1073741824" returned: 0 in 1.082s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:33 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65 Jul 09 03:07:33 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:33 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d" returned: 0 in 1.056s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:33 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d Jul 09 03:07:33 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:33 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65" returned: 0 in 0.777s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ad431b-1eca-4d0e-ac63-f8a2522a003e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d1978d2-2d05-4e40-84db-5036066f0b65', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fb1b31-6fa8-409c-ac58-fc4f7c0a1222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:34 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d" returned: 0 in 0.721s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d" released by "delete_volume" :: held 1.832s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:34 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Volume volume-5d1978d2-2d05-4e40-84db-5036066f0b65 (5d1978d2-2d05-4e40-84db-5036066f0b65): created successfully Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fb1b31-6fa8-409c-ac58-fc4f7c0a1222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Flow 'volume_create_manager' (dee11a96-6d65-4478-ac9c-56d2005de7f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-263c1b43-39f6-4635-8a3e-6d178d81ecd6 tempest-ServersNegativeTestJSON-1346533042 None] Created volume successfully. Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Created reservations ['161fd549-81dc-4681-aead-32cf7985fd09', '162dccbc-39cb-4426-b609-93ff69b71bbf', '86e4892d-2bd8-4056-a0e8-a1e27d9aec72', 'f0f317e1-7914-4af2-b769-893a6a53a967'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:34 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:07:34 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8977a96b-cb33-45e5-8002-790a51e80683 tempest-GroupsTest-94020062 None] Group tempest-Group2-1403526302: creating Jul 09 03:07:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8977a96b-cb33-45e5-8002-790a51e80683 tempest-GroupsTest-94020062 None] Group tempest-Group2-1403526302: created successfully Jul 09 03:07:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8977a96b-cb33-45e5-8002-790a51e80683 tempest-GroupsTest-94020062 None] Create group completed successfully. Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-321b2944-eb72-448e-aa6b-49ef71912cca-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Lock "cinder-321b2944-eb72-448e-aa6b-49ef71912cca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-quobyte-321b2944-eb72-448e-aa6b-49ef71912cca" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-321b2944-eb72-448e-aa6b-49ef71912cca" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1116a5-c973-4327-860c-1d6ab0b5c5f9]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:34 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca Jul 09 03:07:34 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:34 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.727s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:34 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Deleted volume successfully. Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a3994f73-29d1-4017-b625-699c704626a5 tempest-VolumesGetTest-1542352371 None] Lock "cinder-4339b84d-cfbf-4de9-89d8-e7b4a00dea0d-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:35 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca" returned: 0 in 0.822s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:35 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca Jul 09 03:07:35 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Flow 'volume_create_manager' (76fb0a81-355c-4f39-89b8-1143b8a7adf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43d6042-1bda-42ba-a46d-fbdead3545b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43d6042-1bda-42ba-a46d-fbdead3545b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1039861708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8173676e-9a0a-491e-8bac-9161cef12e62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f1a5c1a4e6d4716a8828fd9ceba8400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:35Z,use_quota=True,user_id='43996118fde645b0a34496bf5be35251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d647e5be-9fed-4537-aecd-c1e56bab1852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d647e5be-9fed-4537-aecd-c1e56bab1852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3917da5f-c70e-49b0-8055-2c705f17e093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3917da5f-c70e-49b0-8055-2c705f17e093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8173676e-9a0a-491e-8bac-9161cef12e62', 'volume_name': 'volume-8173676e-9a0a-491e-8bac-9161cef12e62', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21008b1-7828-460d-9b93-559d9d980f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21008b1-7828-460d-9b93-559d9d980f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584c51a8-1861-48ab-b5db-5ebf86ac6287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:35 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Volume 8173676e-9a0a-491e-8bac-9161cef12e62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8173676e-9a0a-491e-8bac-9161cef12e62', 'volume_size': 1} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1039861708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8173676e-9a0a-491e-8bac-9161cef12e62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f1a5c1a4e6d4716a8828fd9ceba8400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:35Z,use_quota=True,user_id='43996118fde645b0a34496bf5be35251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Creating volume 8173676e-9a0a-491e-8bac-9161cef12e62 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:35 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:35 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62 1073741824 Jul 09 03:07:35 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Acquiring lock "cinder-5d1978d2-2d05-4e40-84db-5036066f0b65-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Lock "cinder-5d1978d2-2d05-4e40-84db-5036066f0b65-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Acquiring lock "cinder-quobyte-5d1978d2-2d05-4e40-84db-5036066f0b65" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Lock "cinder-quobyte-5d1978d2-2d05-4e40-84db-5036066f0b65" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f43b279-8a1c-441a-8216-4da3a72cb118]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:35 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65 Jul 09 03:07:35 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Flow 'volume_create_manager' (eda5f9cb-6be1-4e23-a004-a5887133d3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e0c92b-de38-41bd-9750-6cd557f7bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e0c92b-de38-41bd-9750-6cd557f7bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1219589992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7697b70b-1dbb-495d-93f9-893ef2c88db7,host='devstack@QuobyteHD#QuobyteHD',id=3b899af3-cdf9-4282-935c-6843b86c7332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f2b03bf0824d83b9100c3524a1f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:36Z,use_quota=True,user_id='6fb4d258ff8c481488f37e1e8c8d8d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1445c3e-eb2b-4b08-a289-0d5614605a5c),volume_type_id=f1445c3e-eb2b-4b08-a289-0d5614605a5c)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3df469f-34ce-4145-bf69-294bb5e20cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3df469f-34ce-4145-bf69-294bb5e20cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33b7089-c430-40c1-89dc-a0d498411ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33b7089-c430-40c1-89dc-a0d498411ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b899af3-cdf9-4282-935c-6843b86c7332', 'volume_name': 'volume-3b899af3-cdf9-4282-935c-6843b86c7332', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec88cab0-819b-4007-9038-973e385ce512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec88cab0-819b-4007-9038-973e385ce512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dead94d-2ee2-4b87-b9c0-65a9b4903aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:36 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Volume 3b899af3-cdf9-4282-935c-6843b86c7332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b899af3-cdf9-4282-935c-6843b86c7332', 'volume_size': 1} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:36 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-321b2944-eb72-448e-aa6b-49ef71912cca" returned: 0 in 0.863s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-321b2944-eb72-448e-aa6b-49ef71912cca" released by "delete_volume" :: held 1.748s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Created reservations ['b9751a1a-45d3-41e0-b667-198d14554d1d', 'b27295b9-d99f-4cb1-9b17-6334ea70544c', 'e5059798-76b6-4818-921f-2a7ffb253b01', '845e97ad-de08-4f89-b298-a1d7c8e1e51a'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:36 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:07:36 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:36 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65" returned: 0 in 0.888s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:36 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65 Jul 09 03:07:36 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:36 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62 1073741824" returned: 0 in 1.156s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:36 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62 Jul 09 03:07:36 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:37 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.757s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:37 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Deleted volume successfully. Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-dfe0edf4-ff75-4e94-bebd-683fd162a24d tempest-VolumesGetTest-1542352371 None] Lock "cinder-321b2944-eb72-448e-aa6b-49ef71912cca-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:37 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62" returned: 0 in 0.839s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.394s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7697b70b-1dbb-495d-93f9-893ef2c88db7,created_at=2026-07-09T01:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1219589992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7697b70b-1dbb-495d-93f9-893ef2c88db7,host='devstack@QuobyteHD#QuobyteHD',id=3b899af3-cdf9-4282-935c-6843b86c7332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f2b03bf0824d83b9100c3524a1f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:36Z,use_quota=True,user_id='6fb4d258ff8c481488f37e1e8c8d8d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1445c3e-eb2b-4b08-a289-0d5614605a5c),volume_type_id=f1445c3e-eb2b-4b08-a289-0d5614605a5c)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Creating volume 3b899af3-cdf9-4282-935c-6843b86c7332 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:37 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:37 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5d1978d2-2d05-4e40-84db-5036066f0b65" returned: 0 in 0.970s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:37 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332 1073741824 Jul 09 03:07:37 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584c51a8-1861-48ab-b5db-5ebf86ac6287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8173676e-9a0a-491e-8bac-9161cef12e62', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb65608-103e-4b8c-a5f3-e12574da6f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Lock "cinder-quobyte-5d1978d2-2d05-4e40-84db-5036066f0b65" released by "delete_volume" :: held 1.954s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:37 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Volume volume-8173676e-9a0a-491e-8bac-9161cef12e62 (8173676e-9a0a-491e-8bac-9161cef12e62): created successfully Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb65608-103e-4b8c-a5f3-e12574da6f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Flow 'volume_create_manager' (76fb0a81-355c-4f39-89b8-1143b8a7adf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:37 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bc4eb0fe-2327-4d72-9dca-aa771986e1ee tempest-VolumesTestJSON-1465806037 None] Created volume successfully. Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (302d2ac5-66e1-4541-91ac-18738b2b5984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c3ff61-ba4d-4d7d-b8fc-f8ec57651cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c3ff61-ba4d-4d7d-b8fc-f8ec57651cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-734637141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cc68a0-0ef3-45c1-ab99-b88a221fa570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:38Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0196caab-4353-446e-b950-778ddba98219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0196caab-4353-446e-b950-778ddba98219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3dd3f9-07d5-4b8a-b981-4698c4d378dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3dd3f9-07d5-4b8a-b981-4698c4d378dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1cc68a0-0ef3-45c1-ab99-b88a221fa570', 'volume_name': 'volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e70ff45-5b72-473e-84e5-df4b13077626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e70ff45-5b72-473e-84e5-df4b13077626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4145e0-3041-4b4d-afa6-e8fbf9fcb046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:37 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Volume d1cc68a0-0ef3-45c1-ab99-b88a221fa570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570', 'volume_size': 1} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Created reservations ['2df7bc88-75bd-4109-b68f-082104f0fa2d', 'd1e45ce8-afa8-4c6e-a12a-1d216c9262c8', '39965ca4-86bc-40aa-8c52-b30be6dad1cb', '27a016ff-a2c8-418c-b91e-29d7a566e5df'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:37 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:07:37 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Acquiring lock "cinder-1b23ada0-ca78-4a61-b054-5684ae58812c-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Lock "cinder-1b23ada0-ca78-4a61-b054-5684ae58812c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Acquiring lock "cinder-quobyte-1b23ada0-ca78-4a61-b054-5684ae58812c" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Lock "cinder-quobyte-1b23ada0-ca78-4a61-b054-5684ae58812c" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13b74e5-a264-44dd-b3b5-141d283f8cd9]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:38 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c Jul 09 03:07:38 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:38 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332 1073741824" returned: 0 in 0.909s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:38 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332 Jul 09 03:07:38 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:38 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.828s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Deleted volume successfully. Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e8febeb-c42d-448f-ad8d-837b18ac5a43 tempest-ServersNegativeTestJSON-1346533042 None] Lock "cinder-5d1978d2-2d05-4e40-84db-5036066f0b65-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:38 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c" returned: 0 in 0.842s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:38 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c Jul 09 03:07:38 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:39 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332" returned: 0 in 0.747s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-734637141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cc68a0-0ef3-45c1-ab99-b88a221fa570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:38Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Creating volume d1cc68a0-0ef3-45c1-ab99-b88a221fa570 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:39 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:39 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 1073741824 Jul 09 03:07:39 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dead94d-2ee2-4b87-b9c0-65a9b4903aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b899af3-cdf9-4282-935c-6843b86c7332', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fd55c9-2c4c-46e2-b938-3c6bae59185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:39 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Volume volume-3b899af3-cdf9-4282-935c-6843b86c7332 (3b899af3-cdf9-4282-935c-6843b86c7332): created successfully Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fd55c9-2c4c-46e2-b938-3c6bae59185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Flow 'volume_create_manager' (eda5f9cb-6be1-4e23-a004-a5887133d3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Flow 'volume_create_manager' (88ec1af3-ec59-4d82-b759-e375b04ffc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc1eb9d-5c6b-4eb0-924e-c5efb3cc7b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc1eb9d-5c6b-4eb0-924e-c5efb3cc7b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1076273229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f1a5c1a4e6d4716a8828fd9ceba8400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:39Z,use_quota=True,user_id='43996118fde645b0a34496bf5be35251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013b682b-c466-470c-9731-e194c79fc665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013b682b-c466-470c-9731-e194c79fc665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e96854-8281-472e-8ce4-ca1b6e47f584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e96854-8281-472e-8ce4-ca1b6e47f584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526', 'volume_name': 'volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22010cf7-8765-4c13-a54f-4df88683098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22010cf7-8765-4c13-a54f-4df88683098f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1cc4ac-f8a1-4325-9b05-df53f0e2f479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:39 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Volume 27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526', 'volume_size': 1} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:39 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-540f6853-6a06-4ea3-bfd3-1f7cdb0e6a4a tempest-GroupsTest-94020062 None] Created volume successfully. Jul 09 03:07:39 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b23ada0-ca78-4a61-b054-5684ae58812c" returned: 0 in 0.651s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Lock "cinder-quobyte-1b23ada0-ca78-4a61-b054-5684ae58812c" released by "delete_volume" :: held 1.541s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Created reservations ['eafbac68-c7c0-45c5-99cf-f727b02fb13d', 'ebce34e5-8a90-42ec-908d-74c0e461769b', 'ab0cf8df-9e2c-48f6-8956-3b6525f04cb8', 'b863423a-7385-4ca1-aec3-a6fa0a7783cd'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:39 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:07:39 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:40 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 1073741824" returned: 0 in 1.012s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:40 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 Jul 09 03:07:40 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Acquiring lock "cinder-quobyte-3b899af3-cdf9-4282-935c-6843b86c7332" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Lock "cinder-quobyte-3b899af3-cdf9-4282-935c-6843b86c7332" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:40 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.848s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:40 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:40 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Deleted volume successfully. Jul 09 03:07:40 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9683afb8-0fe4-487a-bde0-50d031e8be0b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2db073a0-9a10-452f-bca1-ee9833430178 tempest-ServersNegativeTestJSON-1346533042 None] Lock "cinder-1b23ada0-ca78-4a61-b054-5684ae58812c-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:40 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332 Jul 09 03:07:40 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:41 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570" returned: 0 in 0.763s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.695s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1076273229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f1a5c1a4e6d4716a8828fd9ceba8400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:39Z,use_quota=True,user_id='43996118fde645b0a34496bf5be35251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Creating volume 27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:41 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:41 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526 1073741824 Jul 09 03:07:41 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4145e0-3041-4b4d-afa6-e8fbf9fcb046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca63b1a-6705-40bf-b108-f8f1488e8670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:41 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Volume volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 (d1cc68a0-0ef3-45c1-ab99-b88a221fa570): created successfully Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca63b1a-6705-40bf-b108-f8f1488e8670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (302d2ac5-66e1-4541-91ac-18738b2b5984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:41 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-98bee64a-58d0-4cab-a9d1-73a0af69b66d tempest-VolumesGetTest-1542352371 None] Created volume successfully. Jul 09 03:07:41 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332" returned: 0 in 0.870s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:41 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332 Jul 09 03:07:41 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:42 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526 1073741824" returned: 0 in 0.979s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:42 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526 Jul 09 03:07:42 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:42 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3b899af3-cdf9-4282-935c-6843b86c7332" returned: 0 in 0.874s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Lock "cinder-quobyte-3b899af3-cdf9-4282-935c-6843b86c7332" released by "delete_volume" :: held 1.838s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Created reservations ['11000746-82ce-477e-95df-84799a828c8b'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:42 devstack cinder-volume[87216]: WARNING cinder.quota [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-369016654 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-369016654, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:07:42 devstack cinder-volume[87216]: WARNING cinder.quota [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-369016654 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-369016654, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (a2e0d41d-05da-4c3c-805e-dc65aa76d842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0700d5-e245-4f3b-bd01-3f60834aadce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Created reservations ['facb97f9-5adb-42ef-9111-605c722b708b', '25c0df66-b1fb-4acd-a3d8-3c73ae9b61c7', 'fbb7238c-b106-416c-b9d5-ec10e7e711e3', '378a0a60-0750-46c3-8cff-412be6e45494'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0700d5-e245-4f3b-bd01-3f60834aadce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-582996192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592d7e7f-78a5-44ae-bd9b-e94e9a0a21af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d1cc68a0-0ef3-45c1-ab99-b88a221fa570,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:43Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204c7fe7-54ed-44ee-8d89-2c9bedb0e0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204c7fe7-54ed-44ee-8d89-2c9bedb0e0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fe530e-62fb-415b-945e-520cb659c7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fe530e-62fb-415b-945e-520cb659c7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '592d7e7f-78a5-44ae-bd9b-e94e9a0a21af', 'volume_name': 'volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af', 'volume_size': 1, 'source_volid': 'd1cc68a0-0ef3-45c1-ab99-b88a221fa570', 'source_volstatus': 'available'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef116dc-eb68-4642-a5bc-7a076158c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef116dc-eb68-4642-a5bc-7a076158c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfae70b-d28c-41c7-92b5-a3dd0d713158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:42 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Volume 592d7e7f-78a5-44ae-bd9b-e94e9a0a21af: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af', 'volume_size': 1, 'source_volid': 'd1cc68a0-0ef3-45c1-ab99-b88a221fa570', 'source_volstatus': 'available'} Jul 09 03:07:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:43 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:07:43 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:43 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526" returned: 0 in 0.914s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.196s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:43 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Cloning volume d1cc68a0-0ef3-45c1-ab99-b88a221fa570 to volume 592d7e7f-78a5-44ae-bd9b-e94e9a0a21af Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1cc4ac-f8a1-4325-9b05-df53f0e2f479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44cd72e-b6c9-48bb-a489-f71b73c8e001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:43 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Volume volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526 (27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526): created successfully Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44cd72e-b6c9-48bb-a489-f71b73c8e001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Flow 'volume_create_manager' (88ec1af3-ec59-4d82-b759-e375b04ffc99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Creating offline snapshot 80f5d90d-c455-4fa3-881b-5fb9a81bed3e of volume d1cc68a0-0ef3-45c1-ab99-b88a221fa570 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:07:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-75452f81-e89b-4199-af9b-e506a69b6156 tempest-VolumesTestJSON-1465806037 None] Created volume successfully. Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f46e33-7e85-4cab-9175-f0eee40f4a89]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:43 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 Jul 09 03:07:43 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:43 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.860s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:43 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-68eba4ea-cef2-4622-b3ef-22e58267266f tempest-GroupsTest-94020062 None] Delete group completed successfully. Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-8fab5c20-174c-4158-899f-b2e39639fc45 tempest-GroupsTest-94020062 None] Created reservations ['7c377a75-fb89-481a-be6f-90cd002d7bf6'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:44 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570" returned: 0 in 1.008s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:44 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e 1G Jul 09 03:07:44 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8fab5c20-174c-4158-899f-b2e39639fc45 tempest-GroupsTest-94020062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8fab5c20-174c-4158-899f-b2e39639fc45 tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8fab5c20-174c-4158-899f-b2e39639fc45 tempest-GroupsTest-94020062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8fab5c20-174c-4158-899f-b2e39639fc45 tempest-GroupsTest-94020062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8fab5c20-174c-4158-899f-b2e39639fc45 tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8fab5c20-174c-4158-899f-b2e39639fc45 tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:44 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:07:44 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Flow 'volume_create_manager' (6be04db0-8d22-4e9b-9414-d110ec083cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f991205-af52-4c80-a653-2cda7d4d2316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f991205-af52-4c80-a653-2cda7d4d2316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-363116650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b79548-5e34-4f87-ae83-671794855bc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f1a5c1a4e6d4716a8828fd9ceba8400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:44Z,use_quota=True,user_id='43996118fde645b0a34496bf5be35251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c00a1d-de5e-4cbb-a2ce-6c15676d29aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c00a1d-de5e-4cbb-a2ce-6c15676d29aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03db4ba-5821-4d46-b95c-b0f3f7a60fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03db4ba-5821-4d46-b95c-b0f3f7a60fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b79548-5e34-4f87-ae83-671794855bc1', 'volume_name': 'volume-44b79548-5e34-4f87-ae83-671794855bc1', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402ca32d-1cd4-4116-b4a5-19d090c35d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402ca32d-1cd4-4116-b4a5-19d090c35d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da69f66-3715-4fc9-ba04-dfbd881cff8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:44 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Volume 44b79548-5e34-4f87-ae83-671794855bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b79548-5e34-4f87-ae83-671794855bc1', 'volume_size': 1} Jul 09 03:07:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:45 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8fab5c20-174c-4158-899f-b2e39639fc45 tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.752s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:45 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-8fab5c20-174c-4158-899f-b2e39639fc45 tempest-GroupsTest-94020062 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8fab5c20-174c-4158-899f-b2e39639fc45 tempest-GroupsTest-94020062 None] Delete group completed successfully. Jul 09 03:07:45 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e 1G" returned: 0 in 0.943s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:45 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e Jul 09 03:07:45 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d44201f5-a85b-4c8f-97f2-6df565f1d861 tempest-GroupsTest-94020062 None] Group tempest-GroupsTest-Group-1985475221: creating Jul 09 03:07:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d44201f5-a85b-4c8f-97f2-6df565f1d861 tempest-GroupsTest-94020062 None] Group tempest-GroupsTest-Group-1985475221: created successfully Jul 09 03:07:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d44201f5-a85b-4c8f-97f2-6df565f1d861 tempest-GroupsTest-94020062 None] Create group completed successfully. Jul 09 03:07:45 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e" returned: 0 in 0.768s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:45 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e is being set with open permissions: ugo+rw Jul 09 03:07:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:45 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e Jul 09 03:07:45 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:46 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e" returned: 0 in 0.659s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:46 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.info Jul 09 03:07:46 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:47 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.info" returned: 0 in 0.693s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:47 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.info is being set with open permissions: ugo+rw Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:47 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.info Jul 09 03:07:47 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Flow 'volume_create_manager' (b6e30ce7-29f7-4452-a4d9-b290c8e774fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f46017d-56ed-46f2-9c64-8d4f60ac5fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f46017d-56ed-46f2-9c64-8d4f60ac5fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1106643042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22a4711a-a4a1-43e1-8ae0-eac07e6822bb,host='devstack@QuobyteHD#QuobyteHD',id=db89a781-89a3-462a-9ca6-f48a268e05b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f2b03bf0824d83b9100c3524a1f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:47Z,use_quota=True,user_id='6fb4d258ff8c481488f37e1e8c8d8d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68d57f21-9a1c-4be4-b7ce-141e2bf2f893),volume_type_id=68d57f21-9a1c-4be4-b7ce-141e2bf2f893)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e35714-d47e-4ec5-b931-88f9254de0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e35714-d47e-4ec5-b931-88f9254de0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11632719-c643-4c45-928d-03b4f8ebaf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11632719-c643-4c45-928d-03b4f8ebaf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db89a781-89a3-462a-9ca6-f48a268e05b4', 'volume_name': 'volume-db89a781-89a3-462a-9ca6-f48a268e05b4', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c0cdc5-33e3-4788-b60c-0b326d0c4378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c0cdc5-33e3-4788-b60c-0b326d0c4378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96482eec-3478-4e69-a741-9ba0018aeb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:47 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Volume db89a781-89a3-462a-9ca6-f48a268e05b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db89a781-89a3-462a-9ca6-f48a268e05b4', 'volume_size': 1} Jul 09 03:07:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:48 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.info" returned: 0 in 0.667s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-quobyte-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] snapshot: 80f5d90d-c455-4fa3-881b-5fb9a81bed3e, volume: 592d7e7f-78a5-44ae-bd9b-e94e9a0a21af, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3f815d-6616-4950-83f7-24aef33de6e6]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:48 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e Jul 09 03:07:48 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:48 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e" returned: 0 in 0.831s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2371928f-94e8-4ea2-b237-823cab8b45d4]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:49 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 Jul 09 03:07:49 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:49 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570" returned: 0 in 0.905s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:49 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:07:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:49 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af Jul 09 03:07:49 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af" returned: 0 in 5.471s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:55 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac3fe6d-9d86-477a-852c-7d9edea0234b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:55 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 Jul 09 03:07:55 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:56 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570" returned: 0 in 0.941s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:56 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:07:56 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Converted 1024.00 MB image at 187.12 MB/s Jul 09 03:07:56 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af is being set with open permissions: ugo+rw Jul 09 03:07:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:56 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af Jul 09 03:07:56 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:56 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af" returned: 0 in 0.683s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af" released by "_copy_volume_from_snapshot" :: held 8.942s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-quobyte-80f5d90d-c455-4fa3-881b-5fb9a81bed3e" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-80f5d90d-c455-4fa3-881b-5fb9a81bed3e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Deleting offline snapshot 80f5d90d-c455-4fa3-881b-5fb9a81bed3e of volume d1cc68a0-0ef3-45c1-ab99-b88a221fa570 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:07:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] snapshot_file for this snap is: volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:07:57 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe9fa46-c0e4-4e50-8e42-3663b4216f76]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:57 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e Jul 09 03:07:57 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:57 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=67,cinder:UPDATE=88,cinder:INSERT=22,cinder:DELETE=9 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:07:57 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e" returned: 0 in 0.808s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:07:57 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c036d34b-c85b-46b5-beb9-835b7720eb73]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:58 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 Jul 09 03:07:58 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:58 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570" returned: 0 in 0.788s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:58 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e Jul 09 03:07:58 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:59 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e" returned: 0 in 0.724s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:59 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e Jul 09 03:07:59 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:00 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570.80f5d90d-c455-4fa3-881b-5fb9a81bed3e" returned: 0 in 0.645s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-80f5d90d-c455-4fa3-881b-5fb9a81bed3e" released by "_delete_snapshot" :: held 3.067s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.982s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.485s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-363116650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b79548-5e34-4f87-ae83-671794855bc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f1a5c1a4e6d4716a8828fd9ceba8400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:44Z,use_quota=True,user_id='43996118fde645b0a34496bf5be35251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Creating volume 44b79548-5e34-4f87-ae83-671794855bc1 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:00 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:00 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1 1073741824 Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfae70b-d28c-41c7-92b5-a3dd0d713158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af', 'volume_size': 1, 'source_volid': 'd1cc68a0-0ef3-45c1-ab99-b88a221fa570', 'source_volstatus': 'available'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:00 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525790f1-1cd1-4869-bcfc-4117c355a6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:00 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Volume volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af (592d7e7f-78a5-44ae-bd9b-e94e9a0a21af): created successfully Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525790f1-1cd1-4869-bcfc-4117c355a6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (a2e0d41d-05da-4c3c-805e-dc65aa76d842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:00 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bb07dfbf-6e44-45f2-8a22-2011886afcbe tempest-VolumesGetTest-1542352371 None] Created volume successfully. Jul 09 03:08:01 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1 1073741824" returned: 0 in 0.906s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:01 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1 Jul 09 03:08:01 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:02 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1" returned: 0 in 0.985s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.481s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22a4711a-a4a1-43e1-8ae0-eac07e6822bb,created_at=2026-07-09T01:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1106643042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22a4711a-a4a1-43e1-8ae0-eac07e6822bb,host='devstack@QuobyteHD#QuobyteHD',id=db89a781-89a3-462a-9ca6-f48a268e05b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f2b03bf0824d83b9100c3524a1f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:47Z,use_quota=True,user_id='6fb4d258ff8c481488f37e1e8c8d8d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68d57f21-9a1c-4be4-b7ce-141e2bf2f893),volume_type_id=68d57f21-9a1c-4be4-b7ce-141e2bf2f893)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Creating volume db89a781-89a3-462a-9ca6-f48a268e05b4 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:02 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:02 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4 1073741824 Jul 09 03:08:02 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da69f66-3715-4fc9-ba04-dfbd881cff8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b79548-5e34-4f87-ae83-671794855bc1', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eadd09c-bf18-4efd-b747-a65f81ddbc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:02 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Volume volume-44b79548-5e34-4f87-ae83-671794855bc1 (44b79548-5e34-4f87-ae83-671794855bc1): created successfully Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eadd09c-bf18-4efd-b747-a65f81ddbc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Flow 'volume_create_manager' (6be04db0-8d22-4e9b-9414-d110ec083cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (555f1f9a-df95-44a3-9faa-fb8570dc05b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f92204-4834-4c51-af72-ce703b696117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:02 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-360ea254-5a5f-447b-89a8-8f7599bfe6b5 tempest-VolumesTestJSON-1465806037 None] Created volume successfully. Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f92204-4834-4c51-af72-ce703b696117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2092380711',display_name='tempest-VolumesGetTest-Volume-686881630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd160e6-bef5-4f03-9ece-3ca416119f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:02Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399a0f67-dc73-496a-8b5b-61c16920487c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399a0f67-dc73-496a-8b5b-61c16920487c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888ca619-a8e9-4ac2-ad20-cf2f635e28d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888ca619-a8e9-4ac2-ad20-cf2f635e28d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccd160e6-bef5-4f03-9ece-3ca416119f84', 'volume_name': 'volume-ccd160e6-bef5-4f03-9ece-3ca416119f84', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac15324e-761c-4353-8f47-dc381b26a161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac15324e-761c-4353-8f47-dc381b26a161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02691716-0288-4951-91b9-905c4c88e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:02 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Volume ccd160e6-bef5-4f03-9ece-3ca416119f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccd160e6-bef5-4f03-9ece-3ca416119f84', 'volume_size': 1} Jul 09 03:08:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:03 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4 1073741824" returned: 0 in 0.998s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:03 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4 Jul 09 03:08:03 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:03 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4" returned: 0 in 0.827s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2092380711',display_name='tempest-VolumesGetTest-Volume-686881630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd160e6-bef5-4f03-9ece-3ca416119f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:02Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Creating volume ccd160e6-bef5-4f03-9ece-3ca416119f84 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:04 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96482eec-3478-4e69-a741-9ba0018aeb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db89a781-89a3-462a-9ca6-f48a268e05b4', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8693ac7a-de40-4e9f-9751-3ece46136528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:04 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84 1073741824 Jul 09 03:08:04 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:04 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Volume volume-db89a781-89a3-462a-9ca6-f48a268e05b4 (db89a781-89a3-462a-9ca6-f48a268e05b4): created successfully Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8693ac7a-de40-4e9f-9751-3ece46136528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Flow 'volume_create_manager' (b6e30ce7-29f7-4452-a4d9-b290c8e774fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:04 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b3a2ac14-3a82-4267-a3ab-4d12c7b01a54 tempest-GroupsTest-94020062 None] Created volume successfully. Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Acquiring lock "cinder-44b79548-5e34-4f87-ae83-671794855bc1-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Lock "cinder-44b79548-5e34-4f87-ae83-671794855bc1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Acquiring lock "cinder-quobyte-44b79548-5e34-4f87-ae83-671794855bc1" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Lock "cinder-quobyte-44b79548-5e34-4f87-ae83-671794855bc1" acquired by "delete_volume" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45665788-efba-45d0-a886-ff55c37d2f61]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:04 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1 Jul 09 03:08:04 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:05 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84 1073741824" returned: 0 in 1.083s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:05 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84 Jul 09 03:08:05 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Flow 'volume_create_manager' (a1e26ff8-efe9-4924-8901-d37e83d451aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce9ca62-17db-4896-8aee-261552f6037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce9ca62-17db-4896-8aee-261552f6037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2139845177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22a4711a-a4a1-43e1-8ae0-eac07e6822bb,host='devstack@QuobyteHD#QuobyteHD',id=18a7b71b-9483-4dbd-9ab0-fba0904e81a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f2b03bf0824d83b9100c3524a1f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:06Z,use_quota=True,user_id='6fb4d258ff8c481488f37e1e8c8d8d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68d57f21-9a1c-4be4-b7ce-141e2bf2f893),volume_type_id=68d57f21-9a1c-4be4-b7ce-141e2bf2f893)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c50b6e-0887-48aa-b3ca-cdc8b4c1b970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c50b6e-0887-48aa-b3ca-cdc8b4c1b970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a90259-4dc0-46de-b797-942348c95b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a90259-4dc0-46de-b797-942348c95b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a7b71b-9483-4dbd-9ab0-fba0904e81a5', 'volume_name': 'volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:05 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcacd6ec-15e8-4d7e-89b7-6cc65170b8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcacd6ec-15e8-4d7e-89b7-6cc65170b8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db9998a-b34c-4e04-b123-7a72b3854842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:05 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Volume 18a7b71b-9483-4dbd-9ab0-fba0904e81a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5', 'volume_size': 1} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1" returned: 0 in 1.090s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:05 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1 Jul 09 03:08:05 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:05 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84" returned: 0 in 0.848s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.256s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22a4711a-a4a1-43e1-8ae0-eac07e6822bb,created_at=2026-07-09T01:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2139845177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22a4711a-a4a1-43e1-8ae0-eac07e6822bb,host='devstack@QuobyteHD#QuobyteHD',id=18a7b71b-9483-4dbd-9ab0-fba0904e81a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f2b03bf0824d83b9100c3524a1f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:06Z,use_quota=True,user_id='6fb4d258ff8c481488f37e1e8c8d8d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68d57f21-9a1c-4be4-b7ce-141e2bf2f893),volume_type_id=68d57f21-9a1c-4be4-b7ce-141e2bf2f893)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Creating volume 18a7b71b-9483-4dbd-9ab0-fba0904e81a5 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:06 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02691716-0288-4951-91b9-905c4c88e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd160e6-bef5-4f03-9ece-3ca416119f84', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:06 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5 1073741824 Jul 09 03:08:06 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f842269f-17fe-451c-9fc4-c828e92283f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:06 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Volume volume-ccd160e6-bef5-4f03-9ece-3ca416119f84 (ccd160e6-bef5-4f03-9ece-3ca416119f84): created successfully Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f842269f-17fe-451c-9fc4-c828e92283f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (555f1f9a-df95-44a3-9faa-fb8570dc05b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:06 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-62b5898f-e718-462d-a157-0417d590e1ff tempest-VolumesGetTest-1542352371 None] Created volume successfully. Jul 09 03:08:06 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-44b79548-5e34-4f87-ae83-671794855bc1" returned: 0 in 0.688s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Lock "cinder-quobyte-44b79548-5e34-4f87-ae83-671794855bc1" released by "delete_volume" :: held 1.855s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Created reservations ['dcd7675d-ad63-4346-b845-d95b302a6f08', '61919872-01f5-4195-ae0a-d3641662f725', 'b766d7f0-8d83-460d-a4ad-6b3d54b45cea', '3c3f9521-b28c-4793-a44f-58a0b2cf54a9'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:06 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:06 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-ccd160e6-bef5-4f03-9ece-3ca416119f84-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Lock "cinder-ccd160e6-bef5-4f03-9ece-3ca416119f84-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-quobyte-ccd160e6-bef5-4f03-9ece-3ca416119f84" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Acquiring lock "cinder-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-ccd160e6-bef5-4f03-9ece-3ca416119f84" acquired by "delete_volume" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Lock "cinder-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a04fed1-2f96-4b56-b338-5c0a594285e6]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Acquiring lock "cinder-quobyte-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Lock "cinder-quobyte-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526" acquired by "delete_volume" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[729b10fc-639c-4beb-b69f-972c644bf156]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:07 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5 1073741824" returned: 0 in 1.287s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:07 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84 Jul 09 03:08:07 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:07 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5 Jul 09 03:08:07 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:07 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526 Jul 09 03:08:07 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:07 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.152s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:07 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Deleted volume successfully. Jul 09 03:08:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-45d3cb40-caa9-4b4e-80f8-14e8a780f8e1 tempest-VolumesTestJSON-1465806037 None] Lock "cinder-44b79548-5e34-4f87-ae83-671794855bc1-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:08 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5" returned: 0 in 1.049s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] <== create_volume: return (2420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db9998a-b34c-4e04-b123-7a72b3854842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c50570-e8c6-455a-a16c-bbbbdeea1d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:08 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Volume volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5 (18a7b71b-9483-4dbd-9ab0-fba0904e81a5): created successfully Jul 09 03:08:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c50570-e8c6-455a-a16c-bbbbdeea1d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Flow 'volume_create_manager' (a1e26ff8-efe9-4924-8901-d37e83d451aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-12f3a27c-6aae-4142-97d9-1027a8b1e0d2 tempest-GroupsTest-94020062 None] Created volume successfully. Jul 09 03:08:08 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526" returned: 0 in 1.426s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:08 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526 Jul 09 03:08:08 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:08 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84" returned: 0 in 1.670s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:08 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84 Jul 09 03:08:08 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:09 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526" returned: 0 in 0.757s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Lock "cinder-quobyte-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526" released by "delete_volume" :: held 2.274s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:09 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ccd160e6-bef5-4f03-9ece-3ca416119f84" returned: 0 in 0.768s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-ccd160e6-bef5-4f03-9ece-3ca416119f84" released by "delete_volume" :: held 2.539s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Created reservations ['7ed779e2-9e92-45b8-bdac-159ba68319a2', 'ef95a7ac-a528-458c-b2b0-564f1ed19f43', '691e113e-6ca5-47e5-b839-e268e85d22a1', 'aa5d6247-b9bb-43b9-9206-f52b1312c5e7'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:09 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-84764291-60e6-4c34-aee2-4a56a51a6498 tempest-GroupsTest-94020062 None] Update group completed successfully. Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Created reservations ['dd8823cb-394a-4b82-9db7-19dc2c56e957', 'e9aa45d8-7edb-453a-a39d-c739f6f014ad', '643ac55f-4a27-4be2-83f0-bd84613d8348', '8c159319-6861-434d-bf3b-34df90e73f7c'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:09 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:09 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:09 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:09 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:10 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.742s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Deleted volume successfully. Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=98,cinder:INSERT=27,cinder:UPDATE=132,cinder:DELETE=7 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Acquiring lock "cinder-8173676e-9a0a-491e-8bac-9161cef12e62-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6df697fd-8a79-4ea0-9509-966f23051322 tempest-VolumesTestJSON-1465806037 None] Lock "cinder-27cbe0e7-4b1f-4daa-b1d5-bcd9ac383526-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:10 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.792s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Lock "cinder-8173676e-9a0a-491e-8bac-9161cef12e62-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Deleted volume successfully. Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b9767bd8-8376-4ca8-afd9-d7f0b82ca334 tempest-VolumesGetTest-1542352371 None] Lock "cinder-ccd160e6-bef5-4f03-9ece-3ca416119f84-delete_volume" released by "delete_volume" :: held 3.751s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Acquiring lock "cinder-quobyte-8173676e-9a0a-491e-8bac-9161cef12e62" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Lock "cinder-quobyte-8173676e-9a0a-491e-8bac-9161cef12e62" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Lock "cinder-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[83afd446-88e4-4d28-be46-6ef5c1306447]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-quobyte-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af" acquired by "delete_volume" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4210cdbe-3fc1-4675-8fde-d222d30e0c63]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:10 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62 Jul 09 03:08:10 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:10 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af Jul 09 03:08:10 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:11 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5da1f3da-ab67-4d77-ab2e-2bb8bb4dc333 tempest-GroupsTest-94020062 None] Update group completed successfully. Jul 09 03:08:11 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62" returned: 0 in 0.923s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:11 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62 Jul 09 03:08:11 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:11 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af" returned: 0 in 0.886s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:11 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af Jul 09 03:08:11 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:12 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8173676e-9a0a-491e-8bac-9161cef12e62" returned: 0 in 0.731s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Lock "cinder-quobyte-8173676e-9a0a-491e-8bac-9161cef12e62" released by "delete_volume" :: held 1.732s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Created reservations ['f3bbe4da-ff81-4f3c-b5fe-6a1e2591e63f', '947e5c8f-7845-48e8-8578-c7826e24466b', 'd5694caa-ec50-4e39-8052-81506d2650c0', 'cb473d13-9b9e-4af8-9ca3-4ff71eb6bd2f'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:12 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af" returned: 0 in 0.783s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af" released by "delete_volume" :: held 1.723s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:12 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:12 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Created reservations ['c9d647c2-bf5d-4a4f-8080-7f9cc9dbd188', '3d73e250-2f5a-44c8-877a-22f714dc053a', 'ad730863-999d-4591-a82a-250558011377', '3f7064e1-1be1-48c7-8340-86fab78059b9'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:12 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:12 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-d1cc68a0-0ef3-45c1-ab99-b88a221fa570-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Acquiring lock "cinder-quobyte-18a7b71b-9483-4dbd-9ab0-fba0904e81a5" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Lock "cinder-d1cc68a0-0ef3-45c1-ab99-b88a221fa570-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Lock "cinder-quobyte-18a7b71b-9483-4dbd-9ab0-fba0904e81a5" acquired by "delete_volume" :: waited 0.065s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4944b7f1-82ed-492c-a144-b6fe11221976]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-quobyte-d1cc68a0-0ef3-45c1-ab99-b88a221fa570" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-d1cc68a0-0ef3-45c1-ab99-b88a221fa570" acquired by "delete_volume" :: waited 0.032s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a72bcd-56d0-4f9b-9c53-32fe88c239ae]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:13 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.158s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:13 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5 Jul 09 03:08:13 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Deleted volume successfully. Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3d487429-890d-4f50-a062-820de04f7faa tempest-VolumesTestJSON-1465806037 None] Lock "cinder-8173676e-9a0a-491e-8bac-9161cef12e62-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:13 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 Jul 09 03:08:13 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:13 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.087s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Deleted volume successfully. Jul 09 03:08:13 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:13 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-59e9c718-3ce9-4fc8-b18a-6a725e9cac47 tempest-VolumesGetTest-1542352371 None] Lock "cinder-592d7e7f-78a5-44ae-bd9b-e94e9a0a21af-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:14 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5" returned: 0 in 1.369s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:14 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.031s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:08:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:08:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:08:14 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5 Jul 09 03:08:14 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:14 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570" returned: 0 in 1.311s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:14 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570 Jul 09 03:08:14 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:15 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-18a7b71b-9483-4dbd-9ab0-fba0904e81a5" returned: 0 in 0.769s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Lock "cinder-quobyte-18a7b71b-9483-4dbd-9ab0-fba0904e81a5" released by "delete_volume" :: held 2.238s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Acquiring lock "cinder-quobyte-db89a781-89a3-462a-9ca6-f48a268e05b4" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Lock "cinder-quobyte-db89a781-89a3-462a-9ca6-f48a268e05b4" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f00baad-0c18-4519-bf81-6597d82c7ae2]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:15 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4 Jul 09 03:08:15 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:15 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1cc68a0-0ef3-45c1-ab99-b88a221fa570" returned: 0 in 0.838s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-d1cc68a0-0ef3-45c1-ab99-b88a221fa570" released by "delete_volume" :: held 2.238s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Created reservations ['c0869799-efad-4a3b-a9ca-82b4b49d9447', 'f8f57675-6257-4c64-ae02-748883d67bb1', '23260284-d1ec-4c52-b35a-6cc8aaddf844', '42c7c809-7c35-4248-b77b-9591365739d6'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:16 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:16 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:16 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4" returned: 0 in 0.789s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:16 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4 Jul 09 03:08:16 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:16 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.851s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:16 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:16 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Deleted volume successfully. Jul 09 03:08:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46c86765-77ca-4aa3-8111-8b3862818701 tempest-VolumesGetTest-1542352371 None] Lock "cinder-d1cc68a0-0ef3-45c1-ab99-b88a221fa570-delete_volume" released by "delete_volume" :: held 3.590s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:17 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-db89a781-89a3-462a-9ca6-f48a268e05b4" returned: 0 in 0.820s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Lock "cinder-quobyte-db89a781-89a3-462a-9ca6-f48a268e05b4" released by "delete_volume" :: held 1.655s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Created reservations ['66fb6f5e-603e-440e-afb5-1ca57f77d945'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:17 devstack cinder-volume[87216]: WARNING cinder.quota [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-539498430 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-539498430, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:08:17 devstack cinder-volume[87216]: WARNING cinder.quota [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-539498430 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-539498430, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Created reservations ['0ff9b943-4544-47d9-94c8-86a02bd992eb', 'f789ba4c-cd10-4893-815d-72c3bd86f33c', '7bdbdb21-0ffb-4bb5-88f6-5d20fa1a489c', 'aeb1f97e-d8ac-4b01-b799-ff5602f87549'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (cb41a56d-c7b1-4673-9c1a-4b2a614a03fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1706df-89d2-4490-8edb-daf9922902e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Created reservations ['8bf42e01-b345-46c9-b127-a3135213b383', '2ae0c0f0-168b-4802-8daa-19b653b6487e', 'a4ddd0e8-623f-4a12-9dc1-f726ba6b820c', 'd6482a47-0c34-4da4-aa83-76cb0e89a546'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1706df-89d2-4490-8edb-daf9922902e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-647274821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff21a78-2da1-4c43-a1a9-993f08592561,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:17Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712dbb51-92d4-4976-9e17-551e70776da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712dbb51-92d4-4976-9e17-551e70776da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c127c822-70cd-48f1-a694-453c11593e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.image.glance [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Creating Keystone auth plugin from conf {{(pid=87216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:17 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:17 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c127c822-70cd-48f1-a694-453c11593e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fff21a78-2da1-4c43-a1a9-993f08592561', 'volume_name': 'volume-fff21a78-2da1-4c43-a1a9-993f08592561', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9aa6b6-dd56-43cb-afe7-e9c842e90896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9aa6b6-dd56-43cb-afe7-e9c842e90896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79738626-ded8-42d2-b0ce-ab565d05bb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:17 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Volume fff21a78-2da1-4c43-a1a9-993f08592561: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fff21a78-2da1-4c43-a1a9-993f08592561', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 03:08:17 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Trying to clone fff21a78-2da1-4c43-a1a9-993f08592561 from image ea6ec930-eba2-423b-9437-18da29841701 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]). {{(pid=87216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:08:18 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:08:18 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Image download 20.69 MB at 20.69 MB/s Jul 09 03:08:18 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1731f651-8dcd-415a-9031-3d398f216a6c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:18 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD Jul 09 03:08:18 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:18 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.041s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:18 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:18 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0fe89093-bd49-411a-a3e5-7d5078c89653 tempest-GroupsTest-94020062 None] Delete group completed successfully. Jul 09 03:08:19 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD" returned: 0 in 1.234s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:19 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Temporary image ea6ec930-eba2-423b-9437-18da29841701 is fetched for user 9df8182e19dd47928047cf987291987a. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:08:19 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2543ac9b-e02d-4d27-8f4b-965b7c57e85a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:19 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD Jul 09 03:08:19 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:20 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD" returned: 0 in 0.965s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-647274821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff21a78-2da1-4c43-a1a9-993f08592561,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:17Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Creating volume fff21a78-2da1-4c43-a1a9-993f08592561 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:20 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:08:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:20 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 1073741824 Jul 09 03:08:20 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:21 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 1073741824" returned: 0 in 1.034s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:21 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 Jul 09 03:08:21 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:22 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561" returned: 0 in 0.877s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:22 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Attempting download of ea6ec930-eba2-423b-9437-18da29841701 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}])) to volume fff21a78-2da1-4c43-a1a9-993f08592561. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:08:22 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b32d671-cf2f-4930-b3ed-c108e1241061]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_0hul8m_7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:23 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_0hul8m_7 Jul 09 03:08:23 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:23 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_0hul8m_7" returned: 0 in 0.805s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_0hul8m_7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:23 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_0hul8m_7 Jul 09 03:08:23 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:24 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_0hul8m_7" returned: 1 in 0.948s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_0hul8m_7' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:08:24 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8286342-3822-403f-93da-663a65264286]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:24 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD Jul 09 03:08:24 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:26 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD" returned: 0 in 1.389s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:26 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] ea6ec930-eba2-423b-9437-18da29841701 was qcow2, converting to raw {{(pid=87216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:08:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:26 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 Jul 09 03:08:26 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-24c2aa95-b4f2-46ad-91de-f5701bb700d1 tempest-GroupsV320Test-752489904 None] Group tempest-GroupsV320Test-Group-912375715: creating Jul 09 03:08:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-24c2aa95-b4f2-46ad-91de-f5701bb700d1 tempest-GroupsV320Test-752489904 None] Group tempest-GroupsV320Test-Group-912375715: created successfully Jul 09 03:08:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-24c2aa95-b4f2-46ad-91de-f5701bb700d1 tempest-GroupsV320Test-752489904 None] Create group completed successfully. Jul 09 03:08:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-440bd6dd-1576-48b2-b452-b89bc41a5028 tempest-GroupsV314Test-76779224 None] Group tempest-GroupsV314Test-Group-1473591564: creating Jul 09 03:08:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-440bd6dd-1576-48b2-b452-b89bc41a5028 tempest-GroupsV314Test-76779224 None] Group tempest-GroupsV314Test-Group-1473591564: created successfully Jul 09 03:08:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-440bd6dd-1576-48b2-b452-b89bc41a5028 tempest-GroupsV314Test-76779224 None] Create group completed successfully. Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-47cf5a38-7908-4b8b-9d96-d5cd841a2b1a tempest-GroupsV320Test-752489904 None] Created reservations ['f5f3df96-29d7-482d-ad40-a75412387fc9'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-47cf5a38-7908-4b8b-9d96-d5cd841a2b1a tempest-GroupsV320Test-752489904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-47cf5a38-7908-4b8b-9d96-d5cd841a2b1a tempest-GroupsV320Test-752489904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-47cf5a38-7908-4b8b-9d96-d5cd841a2b1a tempest-GroupsV320Test-752489904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-47cf5a38-7908-4b8b-9d96-d5cd841a2b1a tempest-GroupsV320Test-752489904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-47cf5a38-7908-4b8b-9d96-d5cd841a2b1a tempest-GroupsV320Test-752489904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-47cf5a38-7908-4b8b-9d96-d5cd841a2b1a tempest-GroupsV320Test-752489904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:28 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:28 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Flow 'volume_create_manager' (540a29eb-71c3-429e-9cc9-af8779146f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a92c91-521a-4279-821a-f9c1f117a26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a92c91-521a-4279-821a-f9c1f117a26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-901040651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35e0ffcc-0f6e-4e9c-bed8-a4d95fb31a73,host='devstack@QuobyteHD#QuobyteHD',id=07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e772002b61cb4329b81c3e2808688e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:28Z,use_quota=True,user_id='5ef45cb834ee400d9cf73d579d0c4eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee3f80b0-3a94-48cd-9d8d-867370d261ab),volume_type_id=ee3f80b0-3a94-48cd-9d8d-867370d261ab)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97e7996-4a04-4220-9e66-eca22853921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97e7996-4a04-4220-9e66-eca22853921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5e1b68-d70e-49c8-b064-a46be3df000e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5e1b68-d70e-49c8-b064-a46be3df000e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf', 'volume_name': 'volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec63594-f500-4443-a471-3057dabef885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec63594-f500-4443-a471-3057dabef885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9cc5b4-c5dd-4e9d-bf96-917d636e70d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:28 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Volume 07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf', 'volume_size': 1} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35e0ffcc-0f6e-4e9c-bed8-a4d95fb31a73,created_at=2026-07-09T01:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-901040651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35e0ffcc-0f6e-4e9c-bed8-a4d95fb31a73,host='devstack@QuobyteHD#QuobyteHD',id=07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e772002b61cb4329b81c3e2808688e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:28Z,use_quota=True,user_id='5ef45cb834ee400d9cf73d579d0c4eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee3f80b0-3a94-48cd-9d8d-867370d261ab),volume_type_id=ee3f80b0-3a94-48cd-9d8d-867370d261ab)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Creating volume 07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:28 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:28 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561" returned: 0 in 2.604s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_c39no8g4devstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:08:28 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Converted 112.00 MB image at 42.98 MB/s Jul 09 03:08:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:28 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf 1073741824 Jul 09 03:08:28 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:28 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 1G Jul 09 03:08:28 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:29 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-47cf5a38-7908-4b8b-9d96-d5cd841a2b1a tempest-GroupsV320Test-752489904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.993s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:29 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-47cf5a38-7908-4b8b-9d96-d5cd841a2b1a tempest-GroupsV320Test-752489904 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:29 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-47cf5a38-7908-4b8b-9d96-d5cd841a2b1a tempest-GroupsV320Test-752489904 None] Delete group completed successfully. Jul 09 03:08:29 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 1G" returned: 0 in 1.019s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0914e7c-0785-4ac7-a73c-da1706c7d9f7]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:29 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf 1073741824" returned: 0 in 1.270s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:30 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 Jul 09 03:08:30 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:30 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf Jul 09 03:08:30 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:31 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561" returned: 0 in 1.226s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:31 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf" returned: 0 in 1.181s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] <== create_volume: return (2531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.536s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9cc5b4-c5dd-4e9d-bf96-917d636e70d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bffc72-18fe-47dd-b8f9-386cde67b69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:31 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Volume volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf (07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf): created successfully Jul 09 03:08:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bffc72-18fe-47dd-b8f9-386cde67b69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Flow 'volume_create_manager' (540a29eb-71c3-429e-9cc9-af8779146f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:31 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c16bed7c-b277-42e4-acc1-5ad82df3cb4f tempest-GroupsV314Test-76779224 None] Created volume successfully. Jul 09 03:08:31 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 Jul 09 03:08:31 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:32 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561" returned: 1 in 1.182s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:08:32 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Downloaded image ea6ec930-eba2-423b-9437-18da29841701 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}])) to volume fff21a78-2da1-4c43-a1a9-993f08592561 successfully. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:08:32 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Temporary image ea6ec930-eba2-423b-9437-18da29841701 for user 9df8182e19dd47928047cf987291987a is deleted. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:08:32 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Marking volume fff21a78-2da1-4c43-a1a9-993f08592561 as bootable. {{(pid=87216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:08:32 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Copying metadata from image ea6ec930-eba2-423b-9437-18da29841701 to fff21a78-2da1-4c43-a1a9-993f08592561. {{(pid=87216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:08:32 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Creating volume glance metadata for volume fff21a78-2da1-4c43-a1a9-993f08592561 backed by image ea6ec930-eba2-423b-9437-18da29841701 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:08:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79738626-ded8-42d2-b0ce-ab565d05bb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff21a78-2da1-4c43-a1a9-993f08592561', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f7df47-05b5-46a7-b87c-0b5e19bc816d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:32 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Volume volume-fff21a78-2da1-4c43-a1a9-993f08592561 (fff21a78-2da1-4c43-a1a9-993f08592561): created successfully Jul 09 03:08:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f7df47-05b5-46a7-b87c-0b5e19bc816d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (cb41a56d-c7b1-4673-9c1a-4b2a614a03fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-33c22e52-8dbd-4a3c-a81b-0dabeffe510a tempest-VolumesGetTest-1542352371 None] Created volume successfully. Jul 09 03:08:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:33 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Cloning volume 07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf to volume bf5df1c5-f789-49c5-be31-11331271b9ee Jul 09 03:08:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Creating offline snapshot 6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 of volume 07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:08:33 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0c5a98-83e0-421e-b37e-02b728e1fd81]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:34 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf Jul 09 03:08:34 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (9049ec38-12cc-4dde-b448-198e8867bedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd381802-e088-4c74-bdeb-ea76855cad49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd381802-e088-4c74-bdeb-ea76855cad49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1025260178',display_name='tempest-VolumesGetTest-Volume-1775773094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f399d99-8fe5-4f1b-912a-8438f9c03dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:34Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10259ac1-b9e8-4693-9363-667a12eb2c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10259ac1-b9e8-4693-9363-667a12eb2c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad73bf3-07c3-41a7-8c9c-cdfc8089b0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad73bf3-07c3-41a7-8c9c-cdfc8089b0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f399d99-8fe5-4f1b-912a-8438f9c03dc4', 'volume_name': 'volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44eaa119-79a1-4f85-9249-0a3902ecac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44eaa119-79a1-4f85-9249-0a3902ecac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80383840-dc0f-433b-9a3a-56ab9dfe9459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:34 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Volume 3f399d99-8fe5-4f1b-912a-8438f9c03dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4', 'volume_size': 1} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:34 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf" returned: 0 in 1.015s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:34 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 1G Jul 09 03:08:34 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:35 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 1G" returned: 0 in 0.940s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:35 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 Jul 09 03:08:35 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:36 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4" returned: 0 in 0.912s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:36 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:08:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:36 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 Jul 09 03:08:36 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:37 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4" returned: 0 in 0.691s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:37 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.info Jul 09 03:08:37 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:38 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.info" returned: 0 in 0.716s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:38 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:08:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:38 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.info Jul 09 03:08:38 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:38 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.info" returned: 0 in 0.802s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Acquiring lock "cinder-quobyte-bf5df1c5-f789-49c5-be31-11331271b9ee" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Lock "cinder-quobyte-bf5df1c5-f789-49c5-be31-11331271b9ee" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] snapshot: 6c25ca05-54da-4e58-b4a3-3a60bd2f78b4, volume: bf5df1c5-f789-49c5-be31-11331271b9ee, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:08:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:39 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b54596-4194-4c81-9f76-18d5821851d1]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:39 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 Jul 09 03:08:39 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:40 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4" returned: 0 in 0.931s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:08:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:08:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:08:40 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c55ef90-40b2-4828-8174-658368eed205]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:40 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf Jul 09 03:08:40 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:41 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf" returned: 0 in 0.946s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:41 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:08:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:41 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee Jul 09 03:08:41 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Flow 'volume_create_manager' (779770f7-9751-42b3-b5b1-bf66aae33584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e529e8-fe25-48a8-bb83-bd67182e9d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e529e8-fe25-48a8-bb83-bd67182e9d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1927207584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d58132-8234-41a3-b1b7-58e6b7a829bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52e6ab531804b468f1c7cbb8105d1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:45Z,use_quota=True,user_id='ce7408d3b6144e40ac72b4aef0a5cc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcca38a-46ec-4b53-b975-1683a1813e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcca38a-46ec-4b53-b975-1683a1813e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df41fb8-3a03-4e70-824b-48297f329964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df41fb8-3a03-4e70-824b-48297f329964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6d58132-8234-41a3-b1b7-58e6b7a829bb', 'volume_name': 'volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9869cb01-a609-41b9-9455-eb8822c5c39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9869cb01-a609-41b9-9455-eb8822c5c39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193f26e3-574d-4426-8416-5aaa5d5ec6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:45 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Volume e6d58132-8234-41a3-b1b7-58e6b7a829bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb', 'volume_size': 1} Jul 09 03:08:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:46 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee" returned: 0 in 5.147s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:46 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e4df24-6242-41c6-95fb-297b003296a4]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:46 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf Jul 09 03:08:46 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:47 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf" returned: 0 in 0.881s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:47 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:08:47 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Converted 1024.00 MB image at 198.90 MB/s Jul 09 03:08:47 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:08:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:47 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee Jul 09 03:08:47 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:47 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee" returned: 0 in 0.606s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Lock "cinder-quobyte-bf5df1c5-f789-49c5-be31-11331271b9ee" released by "_copy_volume_from_snapshot" :: held 8.626s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Acquiring lock "cinder-quobyte-6c25ca05-54da-4e58-b4a3-3a60bd2f78b4" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Lock "cinder-quobyte-6c25ca05-54da-4e58-b4a3-3a60bd2f78b4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Deleting offline snapshot 6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 of volume 07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:08:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] snapshot_file for this snap is: volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:08:47 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcdb4f8-9c8e-48f0-b68a-a8f3a7edba59]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:47 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 Jul 09 03:08:47 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:48 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4" returned: 0 in 0.744s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:08:48 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6ec2fd-3786-4001-830b-48ea19462027]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:48 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf Jul 09 03:08:48 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:49 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf" returned: 0 in 0.779s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:49 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 Jul 09 03:08:49 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:50 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4" returned: 0 in 0.709s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:50 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4 Jul 09 03:08:50 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:50 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf.6c25ca05-54da-4e58-b4a3-3a60bd2f78b4" returned: 0 in 0.655s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Lock "cinder-quobyte-6c25ca05-54da-4e58-b4a3-3a60bd2f78b4" released by "_delete_snapshot" :: held 2.994s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.041s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.133s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1025260178',display_name='tempest-VolumesGetTest-Volume-1775773094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f399d99-8fe5-4f1b-912a-8438f9c03dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f36d2fc0a8343bea8fce81407493a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:34Z,use_quota=True,user_id='9df8182e19dd47928047cf987291987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Creating volume 3f399d99-8fe5-4f1b-912a-8438f9c03dc4 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:50 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:08:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:50 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4 1073741824 Jul 09 03:08:50 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-ca6dca4c-5c10-44a3-99ef-c2fabfc5ae3e tempest-GroupsV314Test-76779224 None] Create group from source-group-35e0ffcc-0f6e-4e9c-bed8-a4d95fb31a73 completed successfully. Jul 09 03:08:51 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4 1073741824" returned: 0 in 0.877s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Acquiring lock "cinder-quobyte-bf5df1c5-f789-49c5-be31-11331271b9ee" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Lock "cinder-quobyte-bf5df1c5-f789-49c5-be31-11331271b9ee" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:51 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fa0bef-e53f-4e9c-9282-cdc5ed7cfc00]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:51 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4 Jul 09 03:08:51 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:51 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee Jul 09 03:08:51 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:52 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Flow 'volume_create_manager' (b963be63-d596-47d1-8f63-7daeecddc87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ab83b1-76cc-4bbc-8460-757f493cf3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4" returned: 0 in 0.867s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.142s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1927207584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d58132-8234-41a3-b1b7-58e6b7a829bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52e6ab531804b468f1c7cbb8105d1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:45Z,use_quota=True,user_id='ce7408d3b6144e40ac72b4aef0a5cc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Creating volume e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:52 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:52 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ab83b1-76cc-4bbc-8460-757f493cf3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1376641029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac058386-d293-493c-b038-9fe03c09c4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8c013a501d4ec89d09ac67e32a3cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:52Z,use_quota=True,user_id='94e46aff9a1d447ea405757f7e5f079b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcf0334-6266-49dd-a361-2d63d842d2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:52 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb 1073741824 Jul 09 03:08:52 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcf0334-6266-49dd-a361-2d63d842d2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf1197c-52f6-443c-99e9-dc1035d19389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf1197c-52f6-443c-99e9-dc1035d19389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac058386-d293-493c-b038-9fe03c09c4db', 'volume_name': 'volume-ac058386-d293-493c-b038-9fe03c09c4db', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed3bd99-c6ca-4d1c-b117-1c285b90eeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed3bd99-c6ca-4d1c-b117-1c285b90eeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4384e95-8a80-453c-b7f7-3f6d37a7eed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:52 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Volume ac058386-d293-493c-b038-9fe03c09c4db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac058386-d293-493c-b038-9fe03c09c4db', 'volume_size': 1} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee" returned: 0 in 0.930s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80383840-dc0f-433b-9a3a-56ab9dfe9459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:52 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee Jul 09 03:08:52 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c737dc4-d144-470a-ace2-8624997f6af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:52 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Volume volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4 (3f399d99-8fe5-4f1b-912a-8438f9c03dc4): created successfully Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c737dc4-d144-470a-ace2-8624997f6af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Flow 'volume_create_manager' (9049ec38-12cc-4dde-b448-198e8867bedb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:52 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1b66906d-c49c-42e2-ba96-1c85aff45950 tempest-VolumesGetTest-1542352371 None] Created volume successfully. Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-3f399d99-8fe5-4f1b-912a-8438f9c03dc4-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Lock "cinder-3f399d99-8fe5-4f1b-912a-8438f9c03dc4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-quobyte-3f399d99-8fe5-4f1b-912a-8438f9c03dc4" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-3f399d99-8fe5-4f1b-912a-8438f9c03dc4" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3d0f8e-a3b6-4d29-8a42-36c7977514e7]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:53 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4 Jul 09 03:08:53 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:53 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bf5df1c5-f789-49c5-be31-11331271b9ee" returned: 0 in 0.776s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Lock "cinder-quobyte-bf5df1c5-f789-49c5-be31-11331271b9ee" released by "delete_volume" :: held 1.769s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:53 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb 1073741824" returned: 0 in 0.882s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:53 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb Jul 09 03:08:53 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Created reservations ['9d253f00-c17e-4a12-bcc8-51c6698255ba'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:53 devstack cinder-volume[87216]: WARNING cinder.quota [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1948004653 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1948004653, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:08:53 devstack cinder-volume[87216]: WARNING cinder.quota [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1948004653 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1948004653, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Created reservations ['94dffedf-cf2c-4530-bde9-6749a4fedeb9', '05183288-e8fe-43f9-9334-9302bfec760a', 'f8249a27-e004-477d-a482-11ae66cd7491', 'fe42fbe4-a9b5-4f5f-83ee-4a3e657340cd'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:53 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:53 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:54 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4" returned: 0 in 0.824s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:54 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4 Jul 09 03:08:54 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:54 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb" returned: 0 in 0.711s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1376641029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac058386-d293-493c-b038-9fe03c09c4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8c013a501d4ec89d09ac67e32a3cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:52Z,use_quota=True,user_id='94e46aff9a1d447ea405757f7e5f079b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Creating volume ac058386-d293-493c-b038-9fe03c09c4db {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:54 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:54 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db 1073741824 Jul 09 03:08:54 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193f26e3-574d-4426-8416-5aaa5d5ec6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27f41e0-b5e1-420e-8fc4-7a4aaa539796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:54 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Volume volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb (e6d58132-8234-41a3-b1b7-58e6b7a829bb): created successfully Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27f41e0-b5e1-420e-8fc4-7a4aaa539796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Flow 'volume_create_manager' (779770f7-9751-42b3-b5b1-bf66aae33584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:54 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a4ea015b-c67c-4547-a921-70ec0723be69 tempest-SnapshotsActionsTest-1796056869 None] Created volume successfully. Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Acquiring lock "cinder-quobyte-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Lock "cinder-quobyte-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:54 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.864s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9461911d-7dc5-4d37-9aec-94eb8128d270]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:54 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-18a38b85-020b-4d74-afa6-80d493892238 tempest-GroupsV314Test-76779224 None] Delete group completed successfully. Jul 09 03:08:54 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf Jul 09 03:08:54 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:54 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3f399d99-8fe5-4f1b-912a-8438f9c03dc4" returned: 0 in 0.905s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-3f399d99-8fe5-4f1b-912a-8438f9c03dc4" released by "delete_volume" :: held 1.773s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:54 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Created reservations ['cd013ccc-4cbd-4345-a1da-39846470e0b1', '7bf57cc2-a509-4e82-96cf-4ed7e5953bc9', '581d6003-31eb-48ee-81a4-b458a241e9c3', 'd008e51b-40eb-41b3-8595-9a3c57036e4b'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:55 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:55 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:55 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db 1073741824" returned: 0 in 1.057s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:55 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db Jul 09 03:08:55 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-fff21a78-2da1-4c43-a1a9-993f08592561-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Lock "cinder-fff21a78-2da1-4c43-a1a9-993f08592561-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:55 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf" returned: 0 in 0.967s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Acquiring lock "cinder-quobyte-fff21a78-2da1-4c43-a1a9-993f08592561" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:55 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf Jul 09 03:08:55 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-fff21a78-2da1-4c43-a1a9-993f08592561" acquired by "delete_volume" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[596331e1-e743-474c-933c-bf6abc536f3b]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:55 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 Jul 09 03:08:55 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:55 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.818s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Deleted volume successfully. Jul 09 03:08:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-da75681a-da55-49a1-b10b-f11f071432f4 tempest-VolumesGetTest-1542352371 None] Lock "cinder-3f399d99-8fe5-4f1b-912a-8438f9c03dc4-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:56 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db" returned: 0 in 0.839s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.211s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4384e95-8a80-453c-b7f7-3f6d37a7eed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac058386-d293-493c-b038-9fe03c09c4db', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca1b929-2dbe-40b9-9998-f5556068c3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] Creating offline snapshot 80955b67-18e7-4c2d-86a0-600791262007 of volume e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:08:56 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Volume volume-ac058386-d293-493c-b038-9fe03c09c4db (ac058386-d293-493c-b038-9fe03c09c4db): created successfully Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca1b929-2dbe-40b9-9998-f5556068c3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Flow 'volume_create_manager' (b963be63-d596-47d1-8f63-7daeecddc87e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce689570-0cfb-41f6-8aaa-b12c8f407997]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:56 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-03ffda33-dee6-49ee-be29-b4b34144baa3 tempest-AttachVolumeShelveTestJSON-508841224 None] Created volume successfully. Jul 09 03:08:56 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb Jul 09 03:08:56 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:56 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf" returned: 0 in 0.893s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Lock "cinder-quobyte-07bdd2fb-e76b-4dc5-ad31-93a02a7cd5bf" released by "delete_volume" :: held 1.954s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Created reservations ['c87d274b-d843-401e-96c6-70d1a42c84af'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:56 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561" returned: 0 in 0.938s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Created reservations ['cf6aa67c-0b8a-4a4a-b0bd-db7dcae9d1c3', 'c2dc632b-90a3-4668-bd79-79d5551ccfea', '114df336-76d7-4f9f-b52c-82d53e57e927', 'd7850b42-1efa-498f-be58-f1f52891ed27'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:56 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 Jul 09 03:08:56 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:56 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:56 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:57 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb" returned: 0 in 0.916s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:57 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 1G Jul 09 03:08:57 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:57 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561" returned: 1 in 0.921s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:08:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:57 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561 Jul 09 03:08:57 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:57 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.041s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:57 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:57 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-97ba969f-e630-49ac-84c4-ed4c447fc94d tempest-GroupsV314Test-76779224 None] Delete group completed successfully. Jul 09 03:08:58 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 1G" returned: 0 in 1.163s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:58 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:08:58 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:58 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fff21a78-2da1-4c43-a1a9-993f08592561" returned: 0 in 0.864s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Lock "cinder-quobyte-fff21a78-2da1-4c43-a1a9-993f08592561" released by "delete_volume" :: held 2.822s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=134,cinder:SELECT=124,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Created reservations ['4a5700b4-9c2f-423d-91f4-8a609bf236ef', '1628f9b1-5044-4f75-b8ec-b6674cea7451', 'c4d25e68-103d-4a79-9482-afa567939188', '3ec4ca48-3786-40d3-ba8b-b4736eed5f6a'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:58 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:08:58 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:59 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 1.079s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:59 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 is being set with open permissions: ugo+rw Jul 09 03:08:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:59 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:08:59 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:59 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.012s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:59 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:59 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Deleted volume successfully. Jul 09 03:08:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6c3ca231-3ab6-413b-94b6-50588ed54f0b tempest-VolumesGetTest-1542352371 None] Lock "cinder-fff21a78-2da1-4c43-a1a9-993f08592561-delete_volume" released by "delete_volume" :: held 4.195s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:00 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 0.867s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:00 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.info Jul 09 03:09:00 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:01 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.info" returned: 0 in 0.832s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:01 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.info is being set with open permissions: ugo+rw Jul 09 03:09:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:01 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.info Jul 09 03:09:01 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:01 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.info" returned: 0 in 0.726s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.737s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-526c6c4c-a76d-44e6-91d5-863d027213b7 tempest-SnapshotsActionsTest-1796056869 None] Create snapshot completed successfully Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Flow 'volume_create_manager' (b295ba66-9c81-4c72-979a-91d8b6310472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8003e4cd-6cb5-4d50-a649-f8565598a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] Creating offline snapshot 1d008311-c102-4f1f-8b0d-b10e638538d5 of volume e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8003e4cd-6cb5-4d50-a649-f8565598a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1429830732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da05e3ce-df74-4101-9506-0ffdf861395d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1030faae51e41c2b00a61efb5c9a593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:03Z,use_quota=True,user_id='09cc9c7bcbd047dabeb3fe1024a81504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16abf6b-a8a6-4b76-9679-7a3f0d2351c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16abf6b-a8a6-4b76-9679-7a3f0d2351c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c48098f-5a5d-4c55-ac87-450ad7a8cd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c48098f-5a5d-4c55-ac87-450ad7a8cd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da05e3ce-df74-4101-9506-0ffdf861395d', 'volume_name': 'volume-da05e3ce-df74-4101-9506-0ffdf861395d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d43d40-e559-40c7-8bbe-67c34587dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d43d40-e559-40c7-8bbe-67c34587dae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557f1600-135c-4bc3-8ac8-0c2103d0c88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:03 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Volume da05e3ce-df74-4101-9506-0ffdf861395d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da05e3ce-df74-4101-9506-0ffdf861395d', 'volume_size': 1} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[085ea769-4ef1-4d63-953a-43abbfb5b780]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:03 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:09:03 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:04 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 0.924s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:04 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 1G Jul 09 03:09:04 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Flow 'volume_create_manager' (394e6e3a-9cb7-4a73-9c2e-6851f4733626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e685259b-470f-4eec-b07d-d3553882fc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e685259b-470f-4eec-b07d-d3553882fc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1197580764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29a7c4e-49fe-4897-b249-c28a76a31ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3a9c1da51b64c1aa24db98f346bf076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:05Z,use_quota=True,user_id='aa414d84c48a4ee0ace959b29dccd5bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd6de60-27d3-45f3-bdd5-15a5c3864560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd6de60-27d3-45f3-bdd5-15a5c3864560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1537d9f6-f714-41d9-b582-c3b23306f826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1537d9f6-f714-41d9-b582-c3b23306f826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a29a7c4e-49fe-4897-b249-c28a76a31ccd', 'volume_name': 'volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c9e157-5add-45e5-aed9-5f1ca56bb660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c9e157-5add-45e5-aed9-5f1ca56bb660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12364e85-6879-4c85-b1b0-5ba97c49dc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:04 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Volume a29a7c4e-49fe-4897-b249-c28a76a31ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd', 'volume_size': 1} Jul 09 03:09:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:05 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 1G" returned: 0 in 0.916s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:05 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 Jul 09 03:09:05 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:06 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5" returned: 0 in 0.825s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:06 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 is being set with open permissions: ugo+rw Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:06 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 Jul 09 03:09:06 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:06 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5" returned: 0 in 0.696s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.545s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.403s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1429830732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da05e3ce-df74-4101-9506-0ffdf861395d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1030faae51e41c2b00a61efb5c9a593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:03Z,use_quota=True,user_id='09cc9c7bcbd047dabeb3fe1024a81504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Creating volume da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:09:06 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:09:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:06 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d 1073741824 Jul 09 03:09:06 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:06 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0e378b34-0967-4e71-a581-6860503a6591 tempest-SnapshotsActionsTest-1796056869 None] Create snapshot completed successfully Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-1d008311-c102-4f1f-8b0d-b10e638538d5-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-1d008311-c102-4f1f-8b0d-b10e638538d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-quobyte-1d008311-c102-4f1f-8b0d-b10e638538d5" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-1d008311-c102-4f1f-8b0d-b10e638538d5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Deleting offline snapshot 1d008311-c102-4f1f-8b0d-b10e638538d5 of volume e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] snapshot_file for this snap is: volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adcf11b-206a-44f4-8ede-9605eeebfa1b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:07 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d 1073741824" returned: 0 in 0.898s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:07 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 Jul 09 03:09:07 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:07 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d Jul 09 03:09:07 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:08 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5" returned: 0 in 0.840s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4ebf3a-3dd1-4613-b5a3-cda3fec1ea86]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:08 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d" returned: 0 in 0.810s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.909s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1197580764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29a7c4e-49fe-4897-b249-c28a76a31ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3a9c1da51b64c1aa24db98f346bf076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:05Z,use_quota=True,user_id='aa414d84c48a4ee0ace959b29dccd5bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Creating volume a29a7c4e-49fe-4897-b249-c28a76a31ccd {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:09:08 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557f1600-135c-4bc3-8ac8-0c2103d0c88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da05e3ce-df74-4101-9506-0ffdf861395d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f270aafe-e69f-4973-8af8-7c8f51e8c481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:08 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:09:08 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd 1073741824 Jul 09 03:09:08 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:08 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:08 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Volume volume-da05e3ce-df74-4101-9506-0ffdf861395d (da05e3ce-df74-4101-9506-0ffdf861395d): created successfully Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f270aafe-e69f-4973-8af8-7c8f51e8c481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Flow 'volume_create_manager' (b295ba66-9c81-4c72-979a-91d8b6310472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-dd0efe76-ea49-48cb-8f94-460a5f3e30a5 tempest-VolumesSnapshotListTestJSON-1299126782 None] Created volume successfully. Jul 09 03:09:09 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 0.853s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:09 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 Jul 09 03:09:09 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:09 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd 1073741824" returned: 0 in 1.015s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:09 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd Jul 09 03:09:09 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:10 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd" returned: 0 in 0.760s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.378s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] Creating offline snapshot adb66c3f-60db-40eb-bacb-6cc3fa3133a2 of volume da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12364e85-6879-4c85-b1b0-5ba97c49dc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:10 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b0fa42-e4b8-405e-8818-9c9530a76366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03a7983-bdb4-4e79-8249-d7cceaa8686e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5" returned: 0 in 1.161s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:10 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Volume volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd (a29a7c4e-49fe-4897-b249-c28a76a31ccd): created successfully Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b0fa42-e4b8-405e-8818-9c9530a76366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Flow 'volume_create_manager' (394e6e3a-9cb7-4a73-9c2e-6851f4733626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:10 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5 Jul 09 03:09:10 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:10 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=86,cinder:UPDATE=124,cinder:INSERT=29,cinder:DELETE=6 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:09:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-738798da-bcb5-47ba-9f48-58fb495e5539 tempest-VolumesServicesTestJSON-1213503438 None] Created volume successfully. Jul 09 03:09:10 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d Jul 09 03:09:10 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Acquiring lock "cinder-a29a7c4e-49fe-4897-b249-c28a76a31ccd-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Lock "cinder-a29a7c4e-49fe-4897-b249-c28a76a31ccd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Acquiring lock "cinder-quobyte-a29a7c4e-49fe-4897-b249-c28a76a31ccd" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Lock "cinder-quobyte-a29a7c4e-49fe-4897-b249-c28a76a31ccd" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea57595-61ef-41a4-a756-416424c2a23b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:11 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.1d008311-c102-4f1f-8b0d-b10e638538d5" returned: 0 in 0.981s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-1d008311-c102-4f1f-8b0d-b10e638538d5" released by "_delete_snapshot" :: held 3.953s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" released by "delete_snapshot" :: held 3.980s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:11 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd Jul 09 03:09:11 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Created reservations ['92a88057-f6f9-4934-91aa-30e64298e2e3', '15b8d376-e19c-4b4e-bc1c-78dbba3e2227', '3744d9ef-b84c-44c8-9bbb-41a0ff85402f', '534fdebd-8d20-448e-87d7-265f662da8e5'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:11 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d" returned: 0 in 1.118s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:11 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 1G Jul 09 03:09:11 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:11 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Delete snapshot completed successfully. Jul 09 03:09:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ac163bc7-fae1-4173-9bdb-31aaac16a7b0 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-1d008311-c102-4f1f-8b0d-b10e638538d5-delete_snapshot" released by "delete_snapshot" :: held 4.163s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:12 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd" returned: 0 in 0.933s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:12 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd Jul 09 03:09:12 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:12 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 1G" returned: 0 in 0.957s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da05e3ce-df74-4101-9506-0ffdf861395d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:12 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da05e3ce-df74-4101-9506-0ffdf861395d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 Jul 09 03:09:12 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:13 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a29a7c4e-49fe-4897-b249-c28a76a31ccd" returned: 0 in 0.865s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Lock "cinder-quobyte-a29a7c4e-49fe-4897-b249-c28a76a31ccd" released by "delete_volume" :: held 1.863s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Created reservations ['ce333b01-c437-4964-8fd5-d0ae5375589a', '4b01612c-fc07-4065-95ab-728951c22f20', '45df2d3d-06cb-4049-9c05-38aba679c9fa', '3588f1d2-ff6e-4b42-b1a2-d3f425364411'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:13 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da05e3ce-df74-4101-9506-0ffdf861395d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2" returned: 0 in 0.834s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:13 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 is being set with open permissions: ugo+rw Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:13 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 Jul 09 03:09:13 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:13 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:09:13 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-68198dde-652d-4595-be61-d820820e1502 req-a7a2a58f-5e17-483a-aa3b-51563c5c8c2f tempest-AttachVolumeShelveTestJSON-508841224 None] No connector for attachment 1f6dd648-1033-49bc-b791-7840194d4287; skipping storage backend terminate_connection call. {{(pid=87216) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-68198dde-652d-4595-be61-d820820e1502 req-a7a2a58f-5e17-483a-aa3b-51563c5c8c2f tempest-AttachVolumeShelveTestJSON-508841224 None] Deleting attachment 1f6dd648-1033-49bc-b791-7840194d4287. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:13 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:09:13 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:14 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2" returned: 0 in 0.702s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:14 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.info Jul 09 03:09:14 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:14 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.898s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:09:14 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Deleted volume successfully. Jul 09 03:09:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1a3c4318-010a-4b9d-b98a-8b3337b6129d tempest-VolumesServicesTestJSON-1213503438 None] Lock "cinder-a29a7c4e-49fe-4897-b249-c28a76a31ccd-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:14 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.860s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:09:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:09:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:09:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:09:15 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.info" returned: 0 in 0.788s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:15 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.info is being set with open permissions: ugo+rw Jul 09 03:09:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:15 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.info Jul 09 03:09:15 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:15 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.info" returned: 0 in 0.809s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.332s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.631s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] Creating offline snapshot 99bbe860-5e3e-4e1e-98ff-028796830ca0 of volume e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:15 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-67b343b9-da75-41c4-9ebf-5641e45adf00 tempest-VolumesSnapshotListTestJSON-1299126782 None] Create snapshot completed successfully Jul 09 03:09:15 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa32fd8-0e00-41ba-8de0-808bd717f9a5]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:16 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:09:16 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:16 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 0.893s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:16 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 1G Jul 09 03:09:16 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:17 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 1G" returned: 0 in 0.848s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:17 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 Jul 09 03:09:17 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:18 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0" returned: 0 in 0.767s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:18 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 is being set with open permissions: ugo+rw Jul 09 03:09:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:18 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 Jul 09 03:09:18 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:19 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0" returned: 0 in 0.694s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.339s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.443s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] Creating offline snapshot c996b42d-8b8f-4516-a0dd-2085a2914090 of volume da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[253d6a30-12d0-4c5d-92ab-70f9c3ec67ec]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:19 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-57a1c1ce-8a92-4763-ba1b-33339638ed37 tempest-SnapshotsActionsTest-1796056869 None] Create snapshot completed successfully Jul 09 03:09:19 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 Jul 09 03:09:19 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-99bbe860-5e3e-4e1e-98ff-028796830ca0-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-99bbe860-5e3e-4e1e-98ff-028796830ca0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-quobyte-99bbe860-5e3e-4e1e-98ff-028796830ca0" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-99bbe860-5e3e-4e1e-98ff-028796830ca0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Deleting offline snapshot 99bbe860-5e3e-4e1e-98ff-028796830ca0 of volume e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] snapshot_file for this snap is: volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[921c1fd4-aff8-44d8-a2eb-c481396bb5cd]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:19 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 Jul 09 03:09:19 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:20 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2" returned: 0 in 0.883s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da05e3ce-df74-4101-9506-0ffdf861395d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:20 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 1G Jul 09 03:09:20 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Flow 'volume_create_manager' (ec9e7fdf-1b1f-45b6-b7f8-c7a15d4b9e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc00d61-724a-44d5-ace6-02a3e49bb9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc00d61-724a-44d5-ace6-02a3e49bb9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1206132172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71635ecc-43d3-4555-a3ef-52b268ef23b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d94a10b6afc4290ad773d2c3e38fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:20Z,use_quota=True,user_id='d4c17c59923e4de48d993a74b14cf775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a297af5c-ae8a-42fa-b1b2-dd04d3af27d3),volume_type_id=a297af5c-ae8a-42fa-b1b2-dd04d3af27d3)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9d0f66-af7a-45f3-9b1b-b94322c238e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9d0f66-af7a-45f3-9b1b-b94322c238e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f0c47f-d6d0-499a-b016-b43997410837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f0c47f-d6d0-499a-b016-b43997410837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71635ecc-43d3-4555-a3ef-52b268ef23b9', 'volume_name': 'volume-71635ecc-43d3-4555-a3ef-52b268ef23b9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626b9d00-5af5-4f36-8d29-eae02362c626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626b9d00-5af5-4f36-8d29-eae02362c626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b36352-1ddc-4eb0-a38b-9c40590bd4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:20 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Volume 71635ecc-43d3-4555-a3ef-52b268ef23b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71635ecc-43d3-4555-a3ef-52b268ef23b9', 'volume_size': 1} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:20 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0" returned: 0 in 0.960s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99ecaaf-082a-496c-8259-fc7a7607dc0c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:20 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:09:20 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:21 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 1G" returned: 0 in 0.981s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:21 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 Jul 09 03:09:21 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:21 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 0.802s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:21 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 Jul 09 03:09:21 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:21 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090" returned: 0 in 0.806s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:21 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 is being set with open permissions: ugo+rw Jul 09 03:09:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:21 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 Jul 09 03:09:21 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:22 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0" returned: 0 in 0.942s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:22 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0 Jul 09 03:09:22 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:22 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090" returned: 0 in 0.731s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.515s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.098s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1206132172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71635ecc-43d3-4555-a3ef-52b268ef23b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d94a10b6afc4290ad773d2c3e38fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:20Z,use_quota=True,user_id='d4c17c59923e4de48d993a74b14cf775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a297af5c-ae8a-42fa-b1b2-dd04d3af27d3),volume_type_id=a297af5c-ae8a-42fa-b1b2-dd04d3af27d3)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Creating volume 71635ecc-43d3-4555-a3ef-52b268ef23b9 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:09:22 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:09:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:22 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9 1073741824 Jul 09 03:09:22 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-17c00497-4a28-4983-92a2-b28a8978e45d tempest-VolumesSnapshotListTestJSON-1299126782 None] Create snapshot completed successfully Jul 09 03:09:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:23 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.99bbe860-5e3e-4e1e-98ff-028796830ca0" returned: 0 in 0.878s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-99bbe860-5e3e-4e1e-98ff-028796830ca0" released by "_delete_snapshot" :: held 3.682s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" released by "delete_snapshot" :: held 3.714s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:23 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Created reservations ['648ab952-e049-4b7c-9d56-a45f3f0a1162', '210fec04-a84e-4e13-b0e9-a2d700e07376', 'f2fc3e80-7df8-4c34-be7e-652a1b022523', 'd2c0a122-afb4-4531-8879-3135789d1d5e'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:23 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Delete snapshot completed successfully. Jul 09 03:09:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0627738b-7f23-44dc-94bc-3b50203c70de tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-99bbe860-5e3e-4e1e-98ff-028796830ca0-delete_snapshot" released by "delete_snapshot" :: held 3.906s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:23 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9 1073741824" returned: 0 in 1.034s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:23 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9 Jul 09 03:09:23 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:24 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9" returned: 0 in 0.705s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.318s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b36352-1ddc-4eb0-a38b-9c40590bd4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71635ecc-43d3-4555-a3ef-52b268ef23b9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6145ad09-a91b-4974-9096-fdb93ee34f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] Creating offline snapshot 20488473-5e55-4ab2-bcb1-2a9239d91cfd of volume da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:24 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Volume volume-71635ecc-43d3-4555-a3ef-52b268ef23b9 (71635ecc-43d3-4555-a3ef-52b268ef23b9): created successfully Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6145ad09-a91b-4974-9096-fdb93ee34f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Flow 'volume_create_manager' (ec9e7fdf-1b1f-45b6-b7f8-c7a15d4b9e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[278b3155-e690-4c20-8e56-39907cecf723]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:24 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-81e11f33-cdc0-44d0-9430-e34bb20d7a39 tempest-VolumeTypesAccessTest-1249295876 None] Created volume successfully. Jul 09 03:09:24 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 Jul 09 03:09:24 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Acquiring lock "cinder-71635ecc-43d3-4555-a3ef-52b268ef23b9-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Lock "cinder-71635ecc-43d3-4555-a3ef-52b268ef23b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Acquiring lock "cinder-quobyte-71635ecc-43d3-4555-a3ef-52b268ef23b9" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Lock "cinder-quobyte-71635ecc-43d3-4555-a3ef-52b268ef23b9" acquired by "delete_volume" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:25 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48d88fe-768d-4d83-a3d5-ad8010d80229]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:25 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9 Jul 09 03:09:25 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:25 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090" returned: 0 in 1.195s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da05e3ce-df74-4101-9506-0ffdf861395d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:25 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd 1G Jul 09 03:09:25 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:26 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9" returned: 0 in 0.992s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:26 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9 Jul 09 03:09:26 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:26 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd 1G" returned: 0 in 0.966s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:26 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd Jul 09 03:09:26 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:26 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-71635ecc-43d3-4555-a3ef-52b268ef23b9" returned: 0 in 0.818s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Lock "cinder-quobyte-71635ecc-43d3-4555-a3ef-52b268ef23b9" released by "delete_volume" :: held 1.904s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:26 devstack cinder-volume[87216]: WARNING cinder.quota [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-520765412 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-520765412, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:09:26 devstack cinder-volume[87216]: WARNING cinder.quota [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-520765412 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-520765412, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:09:26 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Created reservations ['1dce32b2-1920-47b4-bef8-49412b750f3e', '21deaaac-35df-4239-849d-66f6013fecd8', 'a08b9df8-09b1-4707-8746-b18182046632', 'bb918337-3395-47fc-b097-8430d11dcade'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:27 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:09:27 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:27 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd" returned: 0 in 0.778s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:27 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd is being set with open permissions: ugo+rw Jul 09 03:09:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:27 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd Jul 09 03:09:27 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:27 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.752s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:27 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:09:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Deleted volume successfully. Jul 09 03:09:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4045be97-9520-4712-96c4-044891f2d9fd tempest-VolumeTypesAccessTest-1249295876 None] Lock "cinder-71635ecc-43d3-4555-a3ef-52b268ef23b9-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:28 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd" returned: 0 in 0.753s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.822s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.124s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] Creating offline snapshot bb7ac897-84b4-48f3-904a-d1d1ec5c759f of volume e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:28 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-167d7596-6795-42b9-b0f4-2c75ca18e7fb tempest-VolumesSnapshotListTestJSON-1299126782 None] Create snapshot completed successfully Jul 09 03:09:28 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaaeab7-7f43-4622-8c3b-8714c6bdbd76]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:28 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:09:28 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:29 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 0.890s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:29 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f 1G Jul 09 03:09:29 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "cinder-20488473-5e55-4ab2-bcb1-2a9239d91cfd-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:30 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f 1G" returned: 0 in 1.248s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-20488473-5e55-4ab2-bcb1-2a9239d91cfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:30 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f Jul 09 03:09:30 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "cinder-quobyte-20488473-5e55-4ab2-bcb1-2a9239d91cfd" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-20488473-5e55-4ab2-bcb1-2a9239d91cfd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Deleting offline snapshot 20488473-5e55-4ab2-bcb1-2a9239d91cfd of volume da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] snapshot_file for this snap is: volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efd72e5-f8b4-4fd4-a863-3cc46af658be]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:30 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd Jul 09 03:09:30 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:31 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f" returned: 0 in 0.809s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:31 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f is being set with open permissions: ugo+rw Jul 09 03:09:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:31 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f Jul 09 03:09:31 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:31 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd" returned: 0 in 1.054s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da05e3ce-df74-4101-9506-0ffdf861395d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:31 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f683d2-7b40-4078-a57c-2be5d6b3c344]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:32 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 Jul 09 03:09:32 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:32 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f" returned: 0 in 1.152s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.318s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5ec08618-170d-4270-b2f1-b75956146e90 tempest-SnapshotsActionsTest-1796056869 None] Create snapshot completed successfully Jul 09 03:09:33 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090" returned: 0 in 1.166s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da05e3ce-df74-4101-9506-0ffdf861395d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:33 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd Jul 09 03:09:33 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-bb7ac897-84b4-48f3-904a-d1d1ec5c759f-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-bb7ac897-84b4-48f3-904a-d1d1ec5c759f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-quobyte-bb7ac897-84b4-48f3-904a-d1d1ec5c759f" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-bb7ac897-84b4-48f3-904a-d1d1ec5c759f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Deleting offline snapshot bb7ac897-84b4-48f3-904a-d1d1ec5c759f of volume e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] snapshot_file for this snap is: volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db37f781-e871-47d2-80bd-8c158c9f9d16]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:34 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd" returned: 0 in 1.081s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:34 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f Jul 09 03:09:34 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:34 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd Jul 09 03:09:34 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:35 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.20488473-5e55-4ab2-bcb1-2a9239d91cfd" returned: 0 in 0.937s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-20488473-5e55-4ab2-bcb1-2a9239d91cfd" released by "_delete_snapshot" :: held 4.426s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" released by "delete_snapshot" :: held 4.471s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:35 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f" returned: 0 in 1.277s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:35 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Created reservations ['64f2f3cb-cd5f-48cb-ba33-cfc2045e06f9', '55ff94bd-c5ea-4fcd-a719-b2990850e3dc', '8165ddbf-96c5-4dad-862c-f5274fb034bb', '9d3eaddb-f8d8-40aa-8a05-d5cffdbb5641'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:35 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9813fba0-cede-4205-bcda-5aafdfd5dcd3]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:35 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Delete snapshot completed successfully. Jul 09 03:09:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b579d0ac-a830-4e14-938a-880169e652ee tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-20488473-5e55-4ab2-bcb1-2a9239d91cfd-delete_snapshot" released by "delete_snapshot" :: held 4.829s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:35 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:09:35 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "cinder-c996b42d-8b8f-4516-a0dd-2085a2914090-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-c996b42d-8b8f-4516-a0dd-2085a2914090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "cinder-quobyte-c996b42d-8b8f-4516-a0dd-2085a2914090" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-c996b42d-8b8f-4516-a0dd-2085a2914090" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Deleting offline snapshot c996b42d-8b8f-4516-a0dd-2085a2914090 of volume da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] snapshot_file for this snap is: volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[208cd0f0-bfbf-462d-b296-73819f7f1c07]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:36 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 Jul 09 03:09:36 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:36 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 1.301s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:36 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f Jul 09 03:09:36 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:37 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090" returned: 0 in 1.219s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da05e3ce-df74-4101-9506-0ffdf861395d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:37 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c994eeae-ae93-47e3-8b47-6e78ca0dcc6d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:37 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 Jul 09 03:09:37 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:37 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f" returned: 0 in 1.182s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:37 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f Jul 09 03:09:37 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:38 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2" returned: 0 in 1.010s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da05e3ce-df74-4101-9506-0ffdf861395d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:38 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 Jul 09 03:09:38 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:38 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.bb7ac897-84b4-48f3-904a-d1d1ec5c759f" returned: 0 in 0.800s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-bb7ac897-84b4-48f3-904a-d1d1ec5c759f" released by "_delete_snapshot" :: held 4.710s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" released by "delete_snapshot" :: held 4.742s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:38 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Created reservations ['4e0b263c-69dd-451b-867b-e86d499a0db1', '09affd8b-db77-4a10-92e7-706cf08b4ce2', '5d4921bc-b0eb-4527-9707-865b6509db68', '313fa724-ec39-4d7a-9d66-ff2e46d0e2cd'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Delete snapshot completed successfully. Jul 09 03:09:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3177aea1-150a-4780-822b-360e8c7f5c50 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-bb7ac897-84b4-48f3-904a-d1d1ec5c759f-delete_snapshot" released by "delete_snapshot" :: held 4.983s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:39 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090" returned: 0 in 0.941s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:39 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090 Jul 09 03:09:39 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] Creating offline snapshot 2d5c31e9-3225-4507-bd6a-18697349fe55 of volume e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:39 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efbf6b0-b7ea-4b46-92d0-ed3350067fe2]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:39 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:09:39 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Flow 'volume_create_manager' (6e35de40-f4c1-4da2-b0e2-e10cc496756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af88d781-2f83-4f03-ab7d-36c1a4cb08cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af88d781-2f83-4f03-ab7d-36c1a4cb08cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-662115605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6b6ac4-9501-460e-868a-5dd60747bc09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a7bf93ddec45068bdb5e09887373dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:40Z,use_quota=True,user_id='1b1a018d985f47d998a7384b558137f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777abb84-7ce8-45bc-aa96-8b4ea3b7d250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777abb84-7ce8-45bc-aa96-8b4ea3b7d250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47760a65-2945-4a0b-abf4-4a09998c5269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47760a65-2945-4a0b-abf4-4a09998c5269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6b6ac4-9501-460e-868a-5dd60747bc09', 'volume_name': 'volume-dc6b6ac4-9501-460e-868a-5dd60747bc09', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b8d680-828f-46d2-a753-d3337a2b236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b8d680-828f-46d2-a753-d3337a2b236d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fed867-d51e-4cf4-b3e2-a687cbd7c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:40 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Volume dc6b6ac4-9501-460e-868a-5dd60747bc09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6b6ac4-9501-460e-868a-5dd60747bc09', 'volume_size': 1} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:40 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.c996b42d-8b8f-4516-a0dd-2085a2914090" returned: 0 in 0.980s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-c996b42d-8b8f-4516-a0dd-2085a2914090" released by "_delete_snapshot" :: held 4.288s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" released by "delete_snapshot" :: held 4.335s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Created reservations ['7bccb591-0387-4485-af1a-778c0fe69a2d', '0184e947-00fd-46af-b16d-a108111bd3af', '83321194-89d3-4d48-bf4f-fe9f2344b402', 'eada139d-6050-4c6f-87f4-8cad87d93812'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:40 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Delete snapshot completed successfully. Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4212bc89-b15c-4c0f-94ca-ea8fbe9bd0f1 tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-c996b42d-8b8f-4516-a0dd-2085a2914090-delete_snapshot" released by "delete_snapshot" :: held 4.540s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:40 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 0.977s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:40 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 1G Jul 09 03:09:40 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "cinder-adb66c3f-60db-40eb-bacb-6cc3fa3133a2-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-adb66c3f-60db-40eb-bacb-6cc3fa3133a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "cinder-quobyte-adb66c3f-60db-40eb-bacb-6cc3fa3133a2" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-adb66c3f-60db-40eb-bacb-6cc3fa3133a2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Deleting offline snapshot adb66c3f-60db-40eb-bacb-6cc3fa3133a2 of volume da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] snapshot_file for this snap is: volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d857d6-8319-4b2c-9d60-764e1692dd09]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:41 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 Jul 09 03:09:41 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:41 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 1G" returned: 0 in 0.946s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:41 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 Jul 09 03:09:41 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:42 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2" returned: 0 in 0.842s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da05e3ce-df74-4101-9506-0ffdf861395d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:42 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55" returned: 0 in 0.725s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:42 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 is being set with open permissions: ugo+rw Jul 09 03:09:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:42 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac4c157-9fde-4241-9772-f3d4d2ee1cbb]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:42 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 Jul 09 03:09:42 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:42 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d Jul 09 03:09:42 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:43 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55" returned: 0 in 0.658s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.446s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.790s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-662115605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6b6ac4-9501-460e-868a-5dd60747bc09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a7bf93ddec45068bdb5e09887373dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:40Z,use_quota=True,user_id='1b1a018d985f47d998a7384b558137f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Creating volume dc6b6ac4-9501-460e-868a-5dd60747bc09 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:09:43 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:43 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09 1073741824 Jul 09 03:09:43 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7aeca859-3247-4337-a4a8-76ba7997ec70 tempest-SnapshotsActionsTest-1796056869 None] Create snapshot completed successfully Jul 09 03:09:43 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d" returned: 0 in 0.864s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:43 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 Jul 09 03:09:43 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-2d5c31e9-3225-4507-bd6a-18697349fe55-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-2d5c31e9-3225-4507-bd6a-18697349fe55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:44 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09 1073741824" returned: 0 in 0.953s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Acquiring lock "cinder-quobyte-2d5c31e9-3225-4507-bd6a-18697349fe55" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-2d5c31e9-3225-4507-bd6a-18697349fe55" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Deleting offline snapshot 2d5c31e9-3225-4507-bd6a-18697349fe55 of volume e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] snapshot_file for this snap is: volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:44 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3b369e-4754-48b6-9a0e-7d7dd609232e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:44 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09 Jul 09 03:09:44 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2" returned: 0 in 0.898s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:44 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2 Jul 09 03:09:44 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:44 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 Jul 09 03:09:44 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:44 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09" returned: 0 in 0.744s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fed867-d51e-4cf4-b3e2-a687cbd7c404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6b6ac4-9501-460e-868a-5dd60747bc09', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19515e7-e4b2-482b-8dd0-aceb4d79bde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:44 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Volume volume-dc6b6ac4-9501-460e-868a-5dd60747bc09 (dc6b6ac4-9501-460e-868a-5dd60747bc09): created successfully Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19515e7-e4b2-482b-8dd0-aceb4d79bde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:44 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Flow 'volume_create_manager' (6e35de40-f4c1-4da2-b0e2-e10cc496756c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d.adb66c3f-60db-40eb-bacb-6cc3fa3133a2" returned: 0 in 0.774s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-fb736a82-3f0d-48c7-b835-5bea389df10a tempest-AbsoluteLimitsTests-1843984986 None] Created volume successfully. Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-adb66c3f-60db-40eb-bacb-6cc3fa3133a2" released by "_delete_snapshot" :: held 3.504s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" released by "delete_snapshot" :: held 3.531s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Created reservations ['a52647aa-66e3-410e-a35c-e2c209c49dd8', '064f4215-0c3f-4544-b042-52b427b5ea85', 'e5776650-c84a-452b-a6cf-411f1e387c0a', '1198d661-7864-4a8e-9469-b599ad6fd221'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Delete snapshot completed successfully. Jul 09 03:09:45 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8fa63961-b226-404a-ae3c-b1c96d67ec8e tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-adb66c3f-60db-40eb-bacb-6cc3fa3133a2-delete_snapshot" released by "delete_snapshot" :: held 3.726s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55" returned: 0 in 1.020s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd44b422-5c64-4f65-824f-8db3611912b0]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:45 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:09:45 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Acquiring lock "cinder-dc6b6ac4-9501-460e-868a-5dd60747bc09-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Lock "cinder-dc6b6ac4-9501-460e-868a-5dd60747bc09-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Acquiring lock "cinder-quobyte-dc6b6ac4-9501-460e-868a-5dd60747bc09" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Lock "cinder-quobyte-dc6b6ac4-9501-460e-868a-5dd60747bc09" acquired by "delete_volume" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f53a63-7485-40c6-91d1-10c1a862bd7f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "cinder-da05e3ce-df74-4101-9506-0ffdf861395d-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-da05e3ce-df74-4101-9506-0ffdf861395d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:46 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09 Jul 09 03:09:46 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:46 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc3c802-1070-4f53-9440-ea45404cd073]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:46 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d Jul 09 03:09:46 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:46 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 0.988s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:46 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 Jul 09 03:09:46 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:46 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09" returned: 0 in 1.036s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:46 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09 Jul 09 03:09:46 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:46 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d" returned: 0 in 0.942s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:47 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d Jul 09 03:09:47 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:47 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55" returned: 0 in 1.084s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:47 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55 Jul 09 03:09:47 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:47 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:47 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dc6b6ac4-9501-460e-868a-5dd60747bc09" returned: 0 in 0.840s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-da05e3ce-df74-4101-9506-0ffdf861395d" returned: 0 in 0.771s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Lock "cinder-quobyte-dc6b6ac4-9501-460e-868a-5dd60747bc09" released by "delete_volume" :: held 1.947s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-quobyte-da05e3ce-df74-4101-9506-0ffdf861395d" released by "delete_volume" :: held 1.785s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Created reservations ['df301df2-ddfd-4138-a489-d9006c4f18be', 'de557a0c-74a5-409a-b4ef-9b2d9f83ba36', '949416cb-ed2f-4648-8546-c0c7139552b5', '14b2bb51-aa63-4521-a14e-d2c06126bbb9'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Created reservations ['52e33612-6ea3-437b-b768-98441f08c329', '31869df2-94c0-47d9-b9eb-cca49e012714', 'e8306b70-d284-42e6-96db-a89ed0f39992', '0b12c40c-cd5d-4e5c-85bb-93c17c988eec'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:47 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:09:47 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:48 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:09:48 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:48 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.2d5c31e9-3225-4507-bd6a-18697349fe55" returned: 0 in 0.741s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-2d5c31e9-3225-4507-bd6a-18697349fe55" released by "_delete_snapshot" :: held 3.964s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" released by "delete_snapshot" :: held 4.001s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Created reservations ['3a84baa7-bdf0-494d-b28f-0c2f952e192d', '1ef70317-7f09-45d9-8be3-86f6b3e79c63', 'ffeeb899-d03a-43ac-a5d1-749f041fa7c2', 'fce0bfb5-f63e-4d39-8267-985debf05ceb'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Delete snapshot completed successfully. Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4d8e6f45-6973-41bc-917a-c80560f1f788 tempest-SnapshotsActionsTest-621495058 None] Lock "cinder-2d5c31e9-3225-4507-bd6a-18697349fe55-delete_snapshot" released by "delete_snapshot" :: held 4.207s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:48 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.767s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:09:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Deleted volume successfully. Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-66faebdb-6129-4065-85fa-a0dec3b93f89 tempest-AbsoluteLimitsTests-1843984986 None] Lock "cinder-dc6b6ac4-9501-460e-868a-5dd60747bc09-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "cinder-80955b67-18e7-4c2d-86a0-600791262007-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:48 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.863s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Lock "cinder-80955b67-18e7-4c2d-86a0-600791262007-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Deleted volume successfully. Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "cinder-quobyte-80955b67-18e7-4c2d-86a0-600791262007" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-56698742-de95-4001-8e3a-3ee6355b339d tempest-VolumesSnapshotListTestJSON-1299126782 None] Lock "cinder-da05e3ce-df74-4101-9506-0ffdf861395d-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Lock "cinder-quobyte-80955b67-18e7-4c2d-86a0-600791262007" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Deleting offline snapshot 80955b67-18e7-4c2d-86a0-600791262007 of volume e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] snapshot_file for this snap is: volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cdc0cd-a9fb-4ad6-b21f-5c67b5eb446e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:49 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:09:49 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:49 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 0.868s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:49 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f39327-4be4-48fb-b4f2-7a202da45a7b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:49 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb Jul 09 03:09:49 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:50 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb" returned: 0 in 0.929s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:50 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:09:50 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:51 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 0.980s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:51 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007 Jul 09 03:09:51 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:51 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:09:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Flow 'volume_create_manager' (c9efb73d-4d8b-4d01-8be4-887fbcd73fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8917fc1c-7012-4459-9cda-d3b37b8ab356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8917fc1c-7012-4459-9cda-d3b37b8ab356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1900962881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7a4da3-bdfb-408b-9724-d045c674f8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353ed4baf50b4621b6553dfc6f5fe2a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:52Z,use_quota=True,user_id='4194b0eaf66744cbb3b8a1ddb3b5f1cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f82e4d-7c76-48e7-a281-aea549119385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f82e4d-7c76-48e7-a281-aea549119385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d8f0b6-5c19-43b0-8d0b-1e7928a318ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d8f0b6-5c19-43b0-8d0b-1e7928a318ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7a4da3-bdfb-408b-9724-d045c674f8d6', 'volume_name': 'volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6', 'volume_size': 2}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9eb474-b0b5-4244-a3d1-ba51a5417634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9eb474-b0b5-4244-a3d1-ba51a5417634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe7032e-bc18-453c-ba46-27f5321c0f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:52 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Volume 2d7a4da3-bdfb-408b-9724-d045c674f8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6', 'volume_size': 2} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1900962881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7a4da3-bdfb-408b-9724-d045c674f8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353ed4baf50b4621b6553dfc6f5fe2a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:52Z,use_quota=True,user_id='4194b0eaf66744cbb3b8a1ddb3b5f1cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Creating volume 2d7a4da3-bdfb-408b-9724-d045c674f8d6 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:09:52 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 2147483648 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:52 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 2147483648 Jul 09 03:09:52 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:52 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb.80955b67-18e7-4c2d-86a0-600791262007" returned: 0 in 0.765s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Lock "cinder-quobyte-80955b67-18e7-4c2d-86a0-600791262007" released by "_delete_snapshot" :: held 3.678s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" released by "delete_snapshot" :: held 3.715s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Created reservations ['c672f9ca-04b8-48d5-a647-3e6831245d63', '5fa92e9b-9957-48fe-8cbd-0d21f5608420', 'bed4d26a-f0a5-4df0-90e1-7fd6acd7b333', '33f344e0-266b-4075-88a9-3002717767e5'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:52 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Delete snapshot completed successfully. Jul 09 03:09:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9c61cd23-036a-49cf-bccb-4a800193847a tempest-SnapshotsActionsTest-1796056869 None] Lock "cinder-80955b67-18e7-4c2d-86a0-600791262007-delete_snapshot" released by "delete_snapshot" :: held 3.893s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:53 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 2147483648" returned: 0 in 1.028s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:53 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 Jul 09 03:09:53 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "cinder-e6d58132-8234-41a3-b1b7-58e6b7a829bb-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Lock "cinder-e6d58132-8234-41a3-b1b7-58e6b7a829bb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" acquired by "delete_volume" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdaa8fd-8425-435e-9c0e-8f1dd9a87bda]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:53 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb Jul 09 03:09:53 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:53 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6" returned: 0 in 0.849s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe7032e-bc18-453c-ba46-27f5321c0f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6', 'volume_size': 2}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1fbf01-722f-4579-9500-39f9bb89d9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:54 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Volume volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 (2d7a4da3-bdfb-408b-9724-d045c674f8d6): created successfully Jul 09 03:09:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1fbf01-722f-4579-9500-39f9bb89d9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Flow 'volume_create_manager' (c9efb73d-4d8b-4d01-8be4-887fbcd73fc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:54 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-566033aa-c6c8-43e6-8809-f103eef62060 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Created volume successfully. Jul 09 03:09:54 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb" returned: 0 in 0.962s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:54 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb Jul 09 03:09:54 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:55 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e6d58132-8234-41a3-b1b7-58e6b7a829bb" returned: 0 in 0.816s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Lock "cinder-quobyte-e6d58132-8234-41a3-b1b7-58e6b7a829bb" released by "delete_volume" :: held 1.869s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Created reservations ['cce59cb3-4200-44a7-b8b8-b931af1e556f', 'c32c25c2-42f0-47c4-9972-307599d2da3e', '478c28a8-4196-4c34-86e8-96bb4a76310a', 'c9528f9f-39be-4bad-b080-46a8f0776ad3'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:55 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:09:55 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Creating offline snapshot e4317962-6e24-4da5-bd1d-827ef72e38b0 of volume 2d7a4da3-bdfb-408b-9724-d045c674f8d6 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3403ca-735e-4be2-8729-6dbf81163d6e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:55 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 Jul 09 03:09:55 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:56 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.180s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:56 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:09:56 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Deleted volume successfully. Jul 09 03:09:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a733394f-d99b-4c2b-b298-1e00db3cb58a tempest-SnapshotsActionsTest-1796056869 None] Lock "cinder-e6d58132-8234-41a3-b1b7-58e6b7a829bb-delete_volume" released by "delete_volume" :: held 3.416s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:56 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6" returned: 0 in 1.274s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 2G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:56 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 2G Jul 09 03:09:56 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:57 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 2G" returned: 0 in 1.121s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:57 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 Jul 09 03:09:57 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:58 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0" returned: 0 in 0.918s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:58 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 is being set with open permissions: ugo+rw Jul 09 03:09:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:58 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 Jul 09 03:09:58 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:59 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0" returned: 0 in 1.051s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:59 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:INSERT=33,cinder:UPDATE=105,cinder:SELECT=102,cinder:DELETE=8 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:09:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:00 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.info Jul 09 03:10:00 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:00 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.info" returned: 0 in 0.745s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:00 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.info is being set with open permissions: ugo+rw Jul 09 03:10:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:00 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.info Jul 09 03:10:00 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:01 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.info" returned: 0 in 0.829s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.108s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f8f913ff-3fff-481e-b202-6c1677c87fe5 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Create snapshot completed successfully Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Acquiring lock "cinder-e4317962-6e24-4da5-bd1d-827ef72e38b0-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "cinder-e4317962-6e24-4da5-bd1d-827ef72e38b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Acquiring lock "cinder-quobyte-2d7a4da3-bdfb-408b-9724-d045c674f8d6" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "cinder-quobyte-2d7a4da3-bdfb-408b-9724-d045c674f8d6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Acquiring lock "cinder-quobyte-e4317962-6e24-4da5-bd1d-827ef72e38b0" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "cinder-quobyte-e4317962-6e24-4da5-bd1d-827ef72e38b0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Deleting offline snapshot e4317962-6e24-4da5-bd1d-827ef72e38b0 of volume 2d7a4da3-bdfb-408b-9724-d045c674f8d6 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] snapshot_file for this snap is: volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06f5930-e2ce-47af-8676-70060d4f80b0]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:02 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 Jul 09 03:10:02 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:03 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0" returned: 0 in 1.152s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:10:03 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd8b03c-ac05-4b4b-a084-9236db7bf45d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:03 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 Jul 09 03:10:03 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:04 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6" returned: 0 in 1.235s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:04 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 Jul 09 03:10:04 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:05 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0" returned: 0 in 1.081s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:05 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0 Jul 09 03:10:05 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Acquiring lock "cinder-ac058386-d293-493c-b038-9fe03c09c4db-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Lock "cinder-ac058386-d293-493c-b038-9fe03c09c4db-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:06 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Acquiring lock "cinder-quobyte-ac058386-d293-493c-b038-9fe03c09c4db" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6.e4317962-6e24-4da5-bd1d-827ef72e38b0" returned: 0 in 0.960s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Lock "cinder-quobyte-ac058386-d293-493c-b038-9fe03c09c4db" acquired by "delete_volume" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:06 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43374a8-297f-43f7-be4c-af63c2e1527b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "cinder-quobyte-e4317962-6e24-4da5-bd1d-827ef72e38b0" released by "_delete_snapshot" :: held 4.609s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "cinder-quobyte-2d7a4da3-bdfb-408b-9724-d045c674f8d6" released by "delete_snapshot" :: held 4.638s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:06 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Created reservations ['7cce51ee-c8f1-4d09-9eb9-0b218dd04d7e', '97b82500-72fb-4323-bb67-97ea7350d122', '88b85c38-ad4b-4c86-84a8-e31894c9b838', '903dd9bf-cd01-490e-8f91-ebf5900c46ef'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:06 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db Jul 09 03:10:06 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:06 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Delete snapshot completed successfully. Jul 09 03:10:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-460478bc-a391-4f0e-a002-df75d480a524 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "cinder-e4317962-6e24-4da5-bd1d-827ef72e38b0-delete_snapshot" released by "delete_snapshot" :: held 4.812s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Acquiring lock "cinder-2d7a4da3-bdfb-408b-9724-d045c674f8d6-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "cinder-2d7a4da3-bdfb-408b-9724-d045c674f8d6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Acquiring lock "cinder-quobyte-2d7a4da3-bdfb-408b-9724-d045c674f8d6" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "cinder-quobyte-2d7a4da3-bdfb-408b-9724-d045c674f8d6" acquired by "delete_volume" :: waited 0.039s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:07 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db" returned: 0 in 1.060s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:07 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68a38d7-46ce-4347-b0a7-4e4d99bdb4d5]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:07 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db Jul 09 03:10:07 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:07 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 Jul 09 03:10:07 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:08 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ac058386-d293-493c-b038-9fe03c09c4db" returned: 0 in 0.965s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Lock "cinder-quobyte-ac058386-d293-493c-b038-9fe03c09c4db" released by "delete_volume" :: held 2.117s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:08 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Created reservations ['41267c6b-2ca1-42e0-bef7-d427e10e8421', '925ce47b-7e71-4b0c-8d4b-f6e5ce1b1209', '7aab1232-35f9-4ca2-8efd-c57efeadebd2', '46eb6d8d-91d4-4730-afb9-a0a81ebef464'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:08 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6" returned: 0 in 1.118s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:08 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6 Jul 09 03:10:08 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:08 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:10:08 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Flow 'volume_create_manager' (f888e8dd-8ed0-45b3-9d8b-0c9ae6f669ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570fd31f-1eb3-4862-87b8-7dc6e1191375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:09 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2d7a4da3-bdfb-408b-9724-d045c674f8d6" returned: 0 in 0.929s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:09 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570fd31f-1eb3-4862-87b8-7dc6e1191375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1317787225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d20f2af-fadd-41be-a572-fd9c2d7d9531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb09aeeb56b4542b88d7d2d9025730d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:09Z,use_quota=True,user_id='d055d4542e3d412bb92bc727ce4cc601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9969b06a-f934-4e7e-aae2-c97e02297e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9969b06a-f934-4e7e-aae2-c97e02297e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0256fce-bfee-49c9-a34b-022b3a2dad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0256fce-bfee-49c9-a34b-022b3a2dad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d20f2af-fadd-41be-a572-fd9c2d7d9531', 'volume_name': 'volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f62d365-b4e5-4830-b50e-67cf7634cfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f62d365-b4e5-4830-b50e-67cf7634cfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ab5d42-006a-43ce-8b9a-a0f95f207f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:09 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Volume 6d20f2af-fadd-41be-a572-fd9c2d7d9531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531', 'volume_size': 1} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1317787225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d20f2af-fadd-41be-a572-fd9c2d7d9531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb09aeeb56b4542b88d7d2d9025730d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:09Z,use_quota=True,user_id='d055d4542e3d412bb92bc727ce4cc601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Creating volume 6d20f2af-fadd-41be-a572-fd9c2d7d9531 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:10:09 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.955s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "cinder-quobyte-2d7a4da3-bdfb-408b-9724-d045c674f8d6" released by "delete_volume" :: held 2.221s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:09 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Deleted volume successfully. Jul 09 03:10:09 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 1073741824 Jul 09 03:10:09 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-92c5a7ce-22ba-427a-b58f-7bdaa18dffd3 tempest-AttachVolumeShelveTestJSON-508841224 None] Lock "cinder-ac058386-d293-493c-b038-9fe03c09c4db-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Created reservations ['71362001-7b4a-4c5d-bd84-f83b09f30f9c', 'c2e7cc66-8a09-4679-a5b9-152142acd854', '0bff75e2-2f83-4b71-a6a5-783ce455b9f5', 'ccfac2f3-b25f-4198-a872-c2795ec0eb2f'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:09 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:10:09 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:10 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.904s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:10 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:10:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Deleted volume successfully. Jul 09 03:10:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-feb9c53e-5350-4584-9991-9eb44d839372 tempest-VolumesSnapshotNegativeTestJSON-1682215005 None] Lock "cinder-2d7a4da3-bdfb-408b-9724-d045c674f8d6-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:10 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 1073741824" returned: 0 in 1.203s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:10 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=110,cinder:INSERT=30,cinder:UPDATE=130,cinder:DELETE=8 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:10:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:10 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 Jul 09 03:10:10 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:12 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531" returned: 0 in 1.090s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:10:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.369s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ab5d42-006a-43ce-8b9a-a0f95f207f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec67c7d1-8571-4013-a08e-f5c8d8e6959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:12 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Volume volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 (6d20f2af-fadd-41be-a572-fd9c2d7d9531): created successfully Jul 09 03:10:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec67c7d1-8571-4013-a08e-f5c8d8e6959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Flow 'volume_create_manager' (f888e8dd-8ed0-45b3-9d8b-0c9ae6f669ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:12 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-795eabca-04e5-4ac4-a135-d3dd7de23aab tempest-VolumesActionsTest-1067442179 None] Created volume successfully. Jul 09 03:10:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:10:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:13 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:10:13 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:15 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.267s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:15 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:10:15 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:10:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:10:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Flow 'volume_create_manager' (cc439f30-5325-41af-82c4-54d2a5fdf160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b6ac33-779b-482d-a0ae-a22fee7a0490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b6ac33-779b-482d-a0ae-a22fee7a0490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-750986875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c04601-05ea-4eb3-9bcd-d72aac347685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ece1c2aca34050a6f936adc76f0938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:16Z,use_quota=True,user_id='579dd1c5fe1340d8ab461d66cc1b4fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22392212-15c6-45f0-98f4-d887ce38b74c),volume_type_id=22392212-15c6-45f0-98f4-d887ce38b74c)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf56557-b6c7-480a-86b7-8d5f1867497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf56557-b6c7-480a-86b7-8d5f1867497e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39879e8-b919-4e05-9aba-49ff03be41a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39879e8-b919-4e05-9aba-49ff03be41a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c04601-05ea-4eb3-9bcd-d72aac347685', 'volume_name': 'volume-14c04601-05ea-4eb3-9bcd-d72aac347685', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850394dc-fcb4-4ca0-b483-162542c50bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850394dc-fcb4-4ca0-b483-162542c50bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416e9778-4a9b-4509-a1de-5f6c7b52f618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:16 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Volume 14c04601-05ea-4eb3-9bcd-d72aac347685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c04601-05ea-4eb3-9bcd-d72aac347685', 'volume_size': 1} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-750986875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c04601-05ea-4eb3-9bcd-d72aac347685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ece1c2aca34050a6f936adc76f0938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:16Z,use_quota=True,user_id='579dd1c5fe1340d8ab461d66cc1b4fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22392212-15c6-45f0-98f4-d887ce38b74c),volume_type_id=22392212-15c6-45f0-98f4-d887ce38b74c)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Creating volume 14c04601-05ea-4eb3-9bcd-d72aac347685 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:10:16 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:10:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:16 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685 1073741824 Jul 09 03:10:16 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:17 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685 1073741824" returned: 0 in 1.142s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:17 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685 Jul 09 03:10:17 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:18 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685" returned: 0 in 0.775s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:10:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416e9778-4a9b-4509-a1de-5f6c7b52f618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c04601-05ea-4eb3-9bcd-d72aac347685', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d364ccb-28ca-4c68-814a-c3b2b28c2720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:18 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Volume volume-14c04601-05ea-4eb3-9bcd-d72aac347685 (14c04601-05ea-4eb3-9bcd-d72aac347685): created successfully Jul 09 03:10:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d364ccb-28ca-4c68-814a-c3b2b28c2720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Flow 'volume_create_manager' (cc439f30-5325-41af-82c4-54d2a5fdf160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:18 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a36b57ba-1e44-4809-9a09-6fe26cea39d6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Created volume successfully. Jul 09 03:10:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-aa191119-d5d0-4b87-91c8-02a37d90e553 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-aa191119-d5d0-4b87-91c8-02a37d90e553 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-aa191119-d5d0-4b87-91c8-02a37d90e553 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-aa191119-d5d0-4b87-91c8-02a37d90e553 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-aa191119-d5d0-4b87-91c8-02a37d90e553 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-aa191119-d5d0-4b87-91c8-02a37d90e553 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:20 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:10:20 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:20 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-aa191119-d5d0-4b87-91c8-02a37d90e553 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.809s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:20 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-aa191119-d5d0-4b87-91c8-02a37d90e553 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:10:20 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-aa191119-d5d0-4b87-91c8-02a37d90e553 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Retype volume completed successfully. Jul 09 03:10:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Acquiring lock "cinder-14c04601-05ea-4eb3-9bcd-d72aac347685-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "cinder-14c04601-05ea-4eb3-9bcd-d72aac347685-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Acquiring lock "cinder-quobyte-14c04601-05ea-4eb3-9bcd-d72aac347685" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "cinder-quobyte-14c04601-05ea-4eb3-9bcd-d72aac347685" acquired by "delete_volume" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:21 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c59004-679e-4ab3-9bce-453cd0a9ae76]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:21 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685 Jul 09 03:10:21 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:22 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685" returned: 0 in 0.979s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:22 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685 Jul 09 03:10:22 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:23 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-14c04601-05ea-4eb3-9bcd-d72aac347685" returned: 0 in 0.800s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "cinder-quobyte-14c04601-05ea-4eb3-9bcd-d72aac347685" released by "delete_volume" :: held 1.845s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:23 devstack cinder-volume[87216]: WARNING cinder.quota [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:10:23 devstack cinder-volume[87216]: WARNING cinder.quota [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:10:23 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Created reservations ['7cdd35d5-c7a1-47e7-893d-2be44b45694e', '84098c9a-0500-4718-aba8-5a3b18bf4d75', '6b9b37fc-4606-49e0-adff-6933a905e238', '39655492-dbdc-4fa8-8417-cde5d613824a'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:23 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:10:23 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:24 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.864s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:24 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:10:24 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Deleted volume successfully. Jul 09 03:10:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e3dccac1-a00e-4c21-bade-6daec5d51ec6 tempest-VolumeRetypeWithoutMigrationTest-520626119 None] Lock "cinder-14c04601-05ea-4eb3-9bcd-d72aac347685-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:33 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=28,cinder:DELETE=3,cinder:UPDATE=41,cinder:INSERT=13 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:10:34 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=16,cinder:DELETE=3,cinder:SELECT=16,cinder:INSERT=2 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Flow 'volume_create_manager' (19530cfb-33cf-481d-9960-21537a634365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab02bf3-9147-4093-9a9d-2bdd2336fabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab02bf3-9147-4093-9a9d-2bdd2336fabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-199800659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd76d866-2498-41e5-81ba-cbdc22d6608d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ffba16850349f992ce2610731d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:46Z,use_quota=True,user_id='ef0cd5c711c24aa7ab8305a17974fb7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(737c7f28-281a-4d7f-b59c-292ecb4942ed),volume_type_id=737c7f28-281a-4d7f-b59c-292ecb4942ed)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb827c4e-63e8-4c5b-83bb-aa46f75aaf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb827c4e-63e8-4c5b-83bb-aa46f75aaf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58cdf5c5-22db-463b-bef3-0bd7d0b0ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58cdf5c5-22db-463b-bef3-0bd7d0b0ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd76d866-2498-41e5-81ba-cbdc22d6608d', 'volume_name': 'volume-dd76d866-2498-41e5-81ba-cbdc22d6608d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b27724-3189-4276-843b-0d3da373a506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b27724-3189-4276-843b-0d3da373a506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35317c71-38ef-48eb-a350-27ef2a5b0d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:45 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Volume dd76d866-2498-41e5-81ba-cbdc22d6608d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd76d866-2498-41e5-81ba-cbdc22d6608d', 'volume_size': 1} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-199800659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd76d866-2498-41e5-81ba-cbdc22d6608d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ffba16850349f992ce2610731d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:46Z,use_quota=True,user_id='ef0cd5c711c24aa7ab8305a17974fb7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(737c7f28-281a-4d7f-b59c-292ecb4942ed),volume_type_id=737c7f28-281a-4d7f-b59c-292ecb4942ed)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Creating volume dd76d866-2498-41e5-81ba-cbdc22d6608d {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:10:45 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:10:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:46 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d 1073741824 Jul 09 03:10:46 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Flow 'volume_create_manager' (b2e1d1d7-a6cc-4450-9a93-4b5fb8460bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115b6283-aa2a-476c-aaf5-86430874a876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115b6283-aa2a-476c-aaf5-86430874a876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1109609555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e9e1c6-03a1-46a6-9a1c-a11c08bc345c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ffba16850349f992ce2610731d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:46Z,use_quota=True,user_id='ef0cd5c711c24aa7ab8305a17974fb7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(550d66f9-0fc3-48a5-9bf7-28f554508e31),volume_type_id=550d66f9-0fc3-48a5-9bf7-28f554508e31)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb7bb9f-4034-4e38-8ee2-8dc8cf7bcfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb7bb9f-4034-4e38-8ee2-8dc8cf7bcfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c063b38-4d00-4ba7-bc9c-bc80373e24f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c063b38-4d00-4ba7-bc9c-bc80373e24f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e9e1c6-03a1-46a6-9a1c-a11c08bc345c', 'volume_name': 'volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedae055-1efe-412c-9226-37e71ff4d74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedae055-1efe-412c-9226-37e71ff4d74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4803a21-c8cf-47d2-babb-7e9fa1d64f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:46 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Volume 56e9e1c6-03a1-46a6-9a1c-a11c08bc345c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c', 'volume_size': 1} Jul 09 03:10:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:47 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:10:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Flow 'volume_create_manager' (5e71abbe-8cb0-4ced-b504-714ced91caa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5629f48f-e3fb-4be7-bc13-5c8bd9c9e0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5629f48f-e3fb-4be7-bc13-5c8bd9c9e0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1582875757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be72e67-cbc6-4d8e-ab40-a70562f1101b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ffba16850349f992ce2610731d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:47Z,use_quota=True,user_id='ef0cd5c711c24aa7ab8305a17974fb7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4f5224c-cfd0-4070-94c6-28d6d503ce9e),volume_type_id=a4f5224c-cfd0-4070-94c6-28d6d503ce9e)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c22e0c-ac9f-478b-9ab1-5ce9819bb526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c22e0c-ac9f-478b-9ab1-5ce9819bb526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:47 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfb756e-884c-4594-b983-94592a77f299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:47 devstack cinder-volume[87216]: DEBUG cinder.image.glance [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Creating Keystone auth plugin from conf {{(pid=87216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:10:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d 1073741824" returned: 0 in 1.496s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:47 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d Jul 09 03:10:47 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfb756e-884c-4594-b983-94592a77f299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2be72e67-cbc6-4d8e-ab40-a70562f1101b', 'volume_name': 'volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b', 'volume_size': 1, 'image_id': '6a953833-503a-4b82-ab94-970dc6cd4c5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a953833-503a-4b82-ab94-970dc6cd4c5f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--372542989', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65ffba16850349f992ce2610731d7b80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6a953833-503a-4b82-ab94-970dc6cd4c5f', 'created_at': datetime.datetime(2026, 7, 9, 1, 10, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 10, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a953833-503a-4b82-ab94-970dc6cd4c5f/file', 'properties': {}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1613ab78-bddd-4f5f-982d-069d9140dacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1613ab78-bddd-4f5f-982d-069d9140dacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a602ca-22ae-4626-b456-417ff9cc9bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:48 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Volume 2be72e67-cbc6-4d8e-ab40-a70562f1101b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b', 'volume_size': 1, 'image_id': '6a953833-503a-4b82-ab94-970dc6cd4c5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a953833-503a-4b82-ab94-970dc6cd4c5f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--372542989', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65ffba16850349f992ce2610731d7b80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6a953833-503a-4b82-ab94-970dc6cd4c5f', 'created_at': datetime.datetime(2026, 7, 9, 1, 10, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 10, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a953833-503a-4b82-ab94-970dc6cd4c5f/file', 'properties': {}}, 'image_service': } Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Trying to clone 2be72e67-cbc6-4d8e-ab40-a70562f1101b from image 6a953833-503a-4b82-ab94-970dc6cd4c5f at location (None, [{'url': 'file:///opt/stack/data/glance/images/6a953833-503a-4b82-ab94-970dc6cd4c5f', 'metadata': {}}]). {{(pid=87216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:10:48 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d" returned: 0 in 0.865s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] <== create_volume: return (2445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.448s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.931s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1109609555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e9e1c6-03a1-46a6-9a1c-a11c08bc345c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ffba16850349f992ce2610731d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:46Z,use_quota=True,user_id='ef0cd5c711c24aa7ab8305a17974fb7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(550d66f9-0fc3-48a5-9bf7-28f554508e31),volume_type_id=550d66f9-0fc3-48a5-9bf7-28f554508e31)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Creating volume 56e9e1c6-03a1-46a6-9a1c-a11c08bc345c {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:10:48 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35317c71-38ef-48eb-a350-27ef2a5b0d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd76d866-2498-41e5-81ba-cbdc22d6608d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:48 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c 1073741824 Jul 09 03:10:48 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f5d664-43c3-4866-9cf2-7ba825280a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:48 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Volume volume-dd76d866-2498-41e5-81ba-cbdc22d6608d (dd76d866-2498-41e5-81ba-cbdc22d6608d): created successfully Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f5d664-43c3-4866-9cf2-7ba825280a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Flow 'volume_create_manager' (19530cfb-33cf-481d-9960-21537a634365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f175d4c3-ae82-4e99-b2a2-cfc2bdbfef55 tempest-TestInstancesWithCinderVolumes-354509901 None] Created volume successfully. Jul 09 03:10:49 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c 1073741824" returned: 0 in 1.000s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:49 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c Jul 09 03:10:49 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:50 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c" returned: 0 in 1.153s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] <== create_volume: return (2271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:10:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4803a21-c8cf-47d2-babb-7e9fa1d64f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887740fa-f29d-4204-808a-77dba2d9c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:50 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Volume volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c (56e9e1c6-03a1-46a6-9a1c-a11c08bc345c): created successfully Jul 09 03:10:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887740fa-f29d-4204-808a-77dba2d9c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Flow 'volume_create_manager' (b2e1d1d7-a6cc-4450-9a93-4b5fb8460bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a83f7f03-de82-45ba-babb-660f0b121f6f tempest-TestInstancesWithCinderVolumes-354509901 None] Created volume successfully. Jul 09 03:10:53 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD, size 20.69 MB, duration 5.25 sec {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:10:53 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Image download 20.69 MB at 3.94 MB/s Jul 09 03:10:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4be790-780f-4c83-981a-0a3397125253]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:53 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD Jul 09 03:10:53 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:54 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD" returned: 0 in 1.439s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:54 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Temporary image 6a953833-503a-4b82-ab94-970dc6cd4c5f is fetched for user ef0cd5c711c24aa7ab8305a17974fb7c. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:10:55 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07c96f0-083f-4c7a-806b-6454e2539e33]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:55 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD Jul 09 03:10:55 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2d4d4bf2-f0e0-4f02-a468-665255ffcf90 tempest-VolumesActionsTest-1067442179 None] Acquiring lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531" by "attach_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2d4d4bf2-f0e0-4f02-a468-665255ffcf90 tempest-VolumesActionsTest-1067442179 None] Lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531" acquired by "attach_volume" :: waited 0.040s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2d4d4bf2-f0e0-4f02-a468-665255ffcf90 tempest-VolumesActionsTest-1067442179 None] Attaching volume 6d20f2af-fadd-41be-a572-fd9c2d7d9531 to instance 227f3b6d-8179-444b-a2dd-3935addf4c07 at mountpoint /dev/vdb on host None. Jul 09 03:10:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2d4d4bf2-f0e0-4f02-a468-665255ffcf90 tempest-VolumesActionsTest-1067442179 None] Attach volume completed successfully. Jul 09 03:10:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2d4d4bf2-f0e0-4f02-a468-665255ffcf90 tempest-VolumesActionsTest-1067442179 None] Lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531" released by "attach_volume" :: held 0.233s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:56 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD" returned: 0 in 1.142s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1582875757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be72e67-cbc6-4d8e-ab40-a70562f1101b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ffba16850349f992ce2610731d7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:47Z,use_quota=True,user_id='ef0cd5c711c24aa7ab8305a17974fb7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4f5224c-cfd0-4070-94c6-28d6d503ce9e),volume_type_id=a4f5224c-cfd0-4070-94c6-28d6d503ce9e)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Creating volume 2be72e67-cbc6-4d8e-ab40-a70562f1101b {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:10:56 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1b423b9b-ccae-480a-badd-bc2762405b2f tempest-VolumesActionsTest-1067442179 None] Acquiring lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531-detach_volume" by "detach_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:56 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b 1073741824 Jul 09 03:10:56 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1b423b9b-ccae-480a-badd-bc2762405b2f tempest-VolumesActionsTest-1067442179 None] Lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:56 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1b423b9b-ccae-480a-badd-bc2762405b2f tempest-VolumesActionsTest-1067442179 None] Detaching volume 6d20f2af-fadd-41be-a572-fd9c2d7d9531 from instance 227f3b6d-8179-444b-a2dd-3935addf4c07. Jul 09 03:10:56 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1b423b9b-ccae-480a-badd-bc2762405b2f tempest-VolumesActionsTest-1067442179 None] Detach volume completed successfully. Jul 09 03:10:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1b423b9b-ccae-480a-badd-bc2762405b2f tempest-VolumesActionsTest-1067442179 None] Lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531-detach_volume" released by "detach_volume" :: held 0.167s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:58 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b 1073741824" returned: 0 in 1.774s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:58 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b Jul 09 03:10:58 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:59 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b" returned: 0 in 1.171s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] <== create_volume: return (3018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:10:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.025s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:59 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Attempting download of 6a953833-503a-4b82-ab94-970dc6cd4c5f ((None, [{'url': 'file:///opt/stack/data/glance/images/6a953833-503a-4b82-ab94-970dc6cd4c5f', 'metadata': {}}])) to volume 2be72e67-cbc6-4d8e-ab40-a70562f1101b. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:10:59 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca2475b-edf7-42c2-a4e8-6e517f10e4cb]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a953833-503a-4b82-ab94-970dc6cd4c5f_8xhrbp2h {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:59 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a953833-503a-4b82-ab94-970dc6cd4c5f_8xhrbp2h Jul 09 03:10:59 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:00 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a953833-503a-4b82-ab94-970dc6cd4c5f_8xhrbp2h" returned: 0 in 0.913s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a953833-503a-4b82-ab94-970dc6cd4c5f_8xhrbp2h {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:00 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a953833-503a-4b82-ab94-970dc6cd4c5f_8xhrbp2h Jul 09 03:11:00 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:01 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a953833-503a-4b82-ab94-970dc6cd4c5f_8xhrbp2h" returned: 1 in 0.855s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a953833-503a-4b82-ab94-970dc6cd4c5f_8xhrbp2h' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:11:01 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb247892-5918-4c2e-a10d-526c0e68883a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:11:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:01 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD Jul 09 03:11:01 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:02 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:02 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] 6a953833-503a-4b82-ab94-970dc6cd4c5f was qcow2, converting to raw {{(pid=87216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:11:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:02 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b Jul 09 03:11:02 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:04 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b" returned: 0 in 2.459s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:04 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6a953833-503a-4b82-ab94-970dc6cd4c5f__lvcok4cdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:11:04 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Converted 112.00 MB image at 45.53 MB/s Jul 09 03:11:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:04 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b 1G Jul 09 03:11:04 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:05 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b 1G" returned: 0 in 1.057s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:05 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cace968-b25a-43d8-b956-b7f2ff5efaa1]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:11:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:05 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b Jul 09 03:11:05 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:06 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b" returned: 0 in 1.232s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:07 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b Jul 09 03:11:07 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:08 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b" returned: 1 in 1.376s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:11:08 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Downloaded image 6a953833-503a-4b82-ab94-970dc6cd4c5f ((None, [{'url': 'file:///opt/stack/data/glance/images/6a953833-503a-4b82-ab94-970dc6cd4c5f', 'metadata': {}}])) to volume 2be72e67-cbc6-4d8e-ab40-a70562f1101b successfully. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:11:08 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Temporary image 6a953833-503a-4b82-ab94-970dc6cd4c5f for user ef0cd5c711c24aa7ab8305a17974fb7c is deleted. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:11:08 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Marking volume 2be72e67-cbc6-4d8e-ab40-a70562f1101b as bootable. {{(pid=87216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:11:08 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Copying metadata from image 6a953833-503a-4b82-ab94-970dc6cd4c5f to 2be72e67-cbc6-4d8e-ab40-a70562f1101b. {{(pid=87216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:11:08 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Creating volume glance metadata for volume 2be72e67-cbc6-4d8e-ab40-a70562f1101b backed by image 6a953833-503a-4b82-ab94-970dc6cd4c5f with: {'image_id': '6a953833-503a-4b82-ab94-970dc6cd4c5f', 'image_name': 'tempest-scenario-img--372542989', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:11:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a602ca-22ae-4626-b456-417ff9cc9bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b', 'volume_size': 1, 'image_id': '6a953833-503a-4b82-ab94-970dc6cd4c5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a953833-503a-4b82-ab94-970dc6cd4c5f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--372542989', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65ffba16850349f992ce2610731d7b80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6a953833-503a-4b82-ab94-970dc6cd4c5f', 'created_at': datetime.datetime(2026, 7, 9, 1, 10, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 10, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a953833-503a-4b82-ab94-970dc6cd4c5f/file', 'properties': {}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699de2ff-e7c8-4f6d-8d5b-4d1dca1cd839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:08 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Volume volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b (2be72e67-cbc6-4d8e-ab40-a70562f1101b): created successfully Jul 09 03:11:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699de2ff-e7c8-4f6d-8d5b-4d1dca1cd839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Flow 'volume_create_manager' (5e71abbe-8cb0-4ced-b504-714ced91caa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:11:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4d81ed8f-15a1-42c2-acba-e4b1b5326d7c tempest-TestInstancesWithCinderVolumes-354509901 None] Created volume successfully. Jul 09 03:11:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:11:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:11:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:11:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:11:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:11:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:11:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:13 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:11:13 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:15 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.241s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:15 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:11:15 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:11:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:11:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:11:18 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=13,cinder:SELECT=17,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:11:18 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=20,cinder:UPDATE=15,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:11:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-39dac75a-7bab-4670-a537-8c00bb98eaae req-167ffed8-025a-488e-a3dc-ce65f6287964 tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:11:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-39dac75a-7bab-4670-a537-8c00bb98eaae req-167ffed8-025a-488e-a3dc-ce65f6287964 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:11:20 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c97aa-47f9-442e-a519-7acd8f893219]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:11:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-39dac75a-7bab-4670-a537-8c00bb98eaae req-167ffed8-025a-488e-a3dc-ce65f6287964 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:21 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b Jul 09 03:11:21 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:21 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-39dac75a-7bab-4670-a537-8c00bb98eaae req-167ffed8-025a-488e-a3dc-ce65f6287964 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b" returned: 0 in 1.037s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-39dac75a-7bab-4670-a537-8c00bb98eaae req-167ffed8-025a-488e-a3dc-ce65f6287964 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:22 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b Jul 09 03:11:22 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:23 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-39dac75a-7bab-4670-a537-8c00bb98eaae req-167ffed8-025a-488e-a3dc-ce65f6287964 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b" returned: 1 in 1.126s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-39dac75a-7bab-4670-a537-8c00bb98eaae req-167ffed8-025a-488e-a3dc-ce65f6287964 tempest-TestInstancesWithCinderVolumes-354509901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:11:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-39dac75a-7bab-4670-a537-8c00bb98eaae req-167ffed8-025a-488e-a3dc-ce65f6287964 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.277s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:11:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-39dac75a-7bab-4670-a537-8c00bb98eaae req-167ffed8-025a-488e-a3dc-ce65f6287964 tempest-TestInstancesWithCinderVolumes-354509901 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30e1aeed-02a1-4fd1-9772-f78ea57edd02', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:11:23 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-39dac75a-7bab-4670-a537-8c00bb98eaae req-167ffed8-025a-488e-a3dc-ce65f6287964 tempest-TestInstancesWithCinderVolumes-354509901 None] attachment_update completed successfully. Jul 09 03:11:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b16aad76-6568-4686-8425-c61e8189b954 tempest-VolumesActionsTest-1067442179 None] Acquiring lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531" by "attach_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:11:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b16aad76-6568-4686-8425-c61e8189b954 tempest-VolumesActionsTest-1067442179 None] Lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531" acquired by "attach_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:11:25 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b16aad76-6568-4686-8425-c61e8189b954 tempest-VolumesActionsTest-1067442179 None] Attaching volume 6d20f2af-fadd-41be-a572-fd9c2d7d9531 to instance 6e81e660-827a-46a0-bb0c-d36c5e0d2b9f at mountpoint /dev/vdb on host None. Jul 09 03:11:25 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b16aad76-6568-4686-8425-c61e8189b954 tempest-VolumesActionsTest-1067442179 None] Attach volume completed successfully. Jul 09 03:11:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b16aad76-6568-4686-8425-c61e8189b954 tempest-VolumesActionsTest-1067442179 None] Lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531" released by "attach_volume" :: held 0.123s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:11:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b9773b8e-1899-40f1-9185-4d02dd216f4c tempest-VolumesActionsTest-1067442179 None] Acquiring lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531-detach_volume" by "detach_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:11:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b9773b8e-1899-40f1-9185-4d02dd216f4c tempest-VolumesActionsTest-1067442179 None] Lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:11:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b9773b8e-1899-40f1-9185-4d02dd216f4c tempest-VolumesActionsTest-1067442179 None] Detaching volume 6d20f2af-fadd-41be-a572-fd9c2d7d9531 from instance 6e81e660-827a-46a0-bb0c-d36c5e0d2b9f. Jul 09 03:11:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b9773b8e-1899-40f1-9185-4d02dd216f4c tempest-VolumesActionsTest-1067442179 None] Detach volume completed successfully. Jul 09 03:11:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b9773b8e-1899-40f1-9185-4d02dd216f4c tempest-VolumesActionsTest-1067442179 None] Lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Flow 'volume_create_manager' (9246b996-bf0f-4ec4-bb1e-7242dd06cb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949f85d6-97ff-46fb-8139-2d6a0f74492d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949f85d6-97ff-46fb-8139-2d6a0f74492d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-946406651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ae7c3d-b25f-49c2-965e-b85102bca368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813cc9f750884cec8eeaa5371e87d794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:11:33Z,use_quota=True,user_id='d9c2ba37694f4371be2b9f7d3abea480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1697e642-0154-43ae-a8c8-11b7e8fc914f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1697e642-0154-43ae-a8c8-11b7e8fc914f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a9fd41-c926-4a45-9d65-54a952ec76b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a9fd41-c926-4a45-9d65-54a952ec76b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74ae7c3d-b25f-49c2-965e-b85102bca368', 'volume_name': 'volume-74ae7c3d-b25f-49c2-965e-b85102bca368', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9675c8-2920-4a17-95d5-0c7a5df3c9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9675c8-2920-4a17-95d5-0c7a5df3c9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0967fe4f-43fe-42e6-a382-107bc405304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:33 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Volume 74ae7c3d-b25f-49c2-965e-b85102bca368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74ae7c3d-b25f-49c2-965e-b85102bca368', 'volume_size': 1} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-946406651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ae7c3d-b25f-49c2-965e-b85102bca368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813cc9f750884cec8eeaa5371e87d794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:11:33Z,use_quota=True,user_id='d9c2ba37694f4371be2b9f7d3abea480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Creating volume 74ae7c3d-b25f-49c2-965e-b85102bca368 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:11:33 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:11:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:33 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368 1073741824 Jul 09 03:11:33 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (a23e88df-1668-454d-91bf-be379a99a3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6305d8b6-cde2-4e34-8d80-b869c47340e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6305d8b6-cde2-4e34-8d80-b869c47340e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1037323179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98a1fff-a76a-48ae-8072-d839e43f5018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:11:35Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16337b5-8b9c-471c-adde-f452a8a033a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16337b5-8b9c-471c-adde-f452a8a033a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb1bb86-5f0c-4ad8-83b3-b550894b2be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb1bb86-5f0c-4ad8-83b3-b550894b2be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98a1fff-a76a-48ae-8072-d839e43f5018', 'volume_name': 'volume-c98a1fff-a76a-48ae-8072-d839e43f5018', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebbc42a-3094-438f-a28f-a1e88a6279f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebbc42a-3094-438f-a28f-a1e88a6279f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5731f5b9-a35d-4f26-b0f4-38a324ed83ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:34 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Volume c98a1fff-a76a-48ae-8072-d839e43f5018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98a1fff-a76a-48ae-8072-d839e43f5018', 'volume_size': 1} Jul 09 03:11:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:11:35 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368 1073741824" returned: 0 in 1.680s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:35 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368 Jul 09 03:11:35 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:36 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368" returned: 0 in 1.060s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] <== create_volume: return (2815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.820s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.290s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1037323179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98a1fff-a76a-48ae-8072-d839e43f5018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:11:35Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Creating volume c98a1fff-a76a-48ae-8072-d839e43f5018 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:11:36 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0967fe4f-43fe-42e6-a382-107bc405304a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74ae7c3d-b25f-49c2-965e-b85102bca368', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:36 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018 1073741824 Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1647ec-fae7-4e89-81ab-bb84674fbd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:36 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:36 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Volume volume-74ae7c3d-b25f-49c2-965e-b85102bca368 (74ae7c3d-b25f-49c2-965e-b85102bca368): created successfully Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1647ec-fae7-4e89-81ab-bb84674fbd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Flow 'volume_create_manager' (9246b996-bf0f-4ec4-bb1e-7242dd06cb67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:11:36 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a29a66de-5d47-4e7f-8c13-57c27287cb35 tempest-AttachVolumeTestJSON-1708502489 None] Created volume successfully. Jul 09 03:11:38 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018 1073741824" returned: 0 in 1.881s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:38 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018 Jul 09 03:11:38 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:39 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018" returned: 0 in 1.439s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] <== create_volume: return (3396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:11:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.404s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:11:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5731f5b9-a35d-4f26-b0f4-38a324ed83ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98a1fff-a76a-48ae-8072-d839e43f5018', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad52175-8332-4dc4-94a0-46d68cac8e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:11:39 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Volume volume-c98a1fff-a76a-48ae-8072-d839e43f5018 (c98a1fff-a76a-48ae-8072-d839e43f5018): created successfully Jul 09 03:11:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad52175-8332-4dc4-94a0-46d68cac8e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:11:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (a23e88df-1668-454d-91bf-be379a99a3af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:11:39 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f86a2ccc-ba39-4ad2-b471-3f0d50fce1b6 tempest-VolumesActionsTest-2025569969 None] Created volume successfully. Jul 09 03:11:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5443a6b7-6788-499a-921c-19d27d821966 tempest-VolumesActionsTest-2025569969 None] Acquiring lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018" by "attach_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:11:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5443a6b7-6788-499a-921c-19d27d821966 tempest-VolumesActionsTest-2025569969 None] Lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018" acquired by "attach_volume" :: waited 0.043s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:11:40 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5443a6b7-6788-499a-921c-19d27d821966 tempest-VolumesActionsTest-2025569969 None] Attaching volume c98a1fff-a76a-48ae-8072-d839e43f5018 to instance 6e8bedfa-8a08-4e3f-8cc2-f116330b6112 at mountpoint /dev/vdb on host None. Jul 09 03:11:40 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5443a6b7-6788-499a-921c-19d27d821966 tempest-VolumesActionsTest-2025569969 None] Attach volume completed successfully. Jul 09 03:11:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5443a6b7-6788-499a-921c-19d27d821966 tempest-VolumesActionsTest-2025569969 None] Lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018" released by "attach_volume" :: held 0.245s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:11:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-1ce270bf-c1f2-47e1-9d52-c1879f36008c req-50c69900-0930-4956-bc98-4a3f4217d500 tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:11:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-1ce270bf-c1f2-47e1-9d52-c1879f36008c req-50c69900-0930-4956-bc98-4a3f4217d500 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:11:41 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca8fb09-3b8c-4d3a-87ea-36130945dcb3]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:11:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-1ce270bf-c1f2-47e1-9d52-c1879f36008c req-50c69900-0930-4956-bc98-4a3f4217d500 tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:41 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368 Jul 09 03:11:41 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:11:42 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-fb92c2d0-e3de-496e-9d9b-c6d6951c83e7 tempest-VolumesActionsTest-558706093 None] Terminate volume connection completed successfully. Jul 09 03:11:42 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-1ce270bf-c1f2-47e1-9d52-c1879f36008c req-50c69900-0930-4956-bc98-4a3f4217d500 tempest-AttachVolumeTestJSON-1708502489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368" returned: 0 in 1.248s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-1ce270bf-c1f2-47e1-9d52-c1879f36008c req-50c69900-0930-4956-bc98-4a3f4217d500 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.289s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:11:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.789s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:11:42 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[812061a0-6fbf-4098-9e97-11da4364a00e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:11:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-1ce270bf-c1f2-47e1-9d52-c1879f36008c req-50c69900-0930-4956-bc98-4a3f4217d500 tempest-AttachVolumeTestJSON-1708502489 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-74ae7c3d-b25f-49c2-965e-b85102bca368', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42a084ec-a1c3-47f9-835a-a1c8b7bd01d2', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:11:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-1ce270bf-c1f2-47e1-9d52-c1879f36008c req-50c69900-0930-4956-bc98-4a3f4217d500 tempest-AttachVolumeTestJSON-1708502489 None] attachment_update completed successfully. Jul 09 03:11:43 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 Jul 09 03:11:43 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-fb92c2d0-e3de-496e-9d9b-c6d6951c83e7 tempest-VolumesActionsTest-558706093 None] Acquiring lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018-detach_volume" by "detach_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:11:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-fb92c2d0-e3de-496e-9d9b-c6d6951c83e7 tempest-VolumesActionsTest-558706093 None] Lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:11:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-fb92c2d0-e3de-496e-9d9b-c6d6951c83e7 tempest-VolumesActionsTest-558706093 None] Detaching volume c98a1fff-a76a-48ae-8072-d839e43f5018 from instance 6e8bedfa-8a08-4e3f-8cc2-f116330b6112. Jul 09 03:11:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-fb92c2d0-e3de-496e-9d9b-c6d6951c83e7 tempest-VolumesActionsTest-558706093 None] Detach volume completed successfully. Jul 09 03:11:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-fb92c2d0-e3de-496e-9d9b-c6d6951c83e7 tempest-VolumesActionsTest-558706093 None] Lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018-detach_volume" released by "detach_volume" :: held 0.196s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:11:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d1a2c0a5-cce7-4a1e-bc34-ab11a66f7abb tempest-VolumesActionsTest-2025569969 None] Acquiring lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018-detach_volume" by "detach_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:11:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d1a2c0a5-cce7-4a1e-bc34-ab11a66f7abb tempest-VolumesActionsTest-2025569969 None] Lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:11:44 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d1a2c0a5-cce7-4a1e-bc34-ab11a66f7abb tempest-VolumesActionsTest-2025569969 None] Volume detach called, but volume not attached. Jul 09 03:11:44 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531" returned: 0 in 1.366s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d1a2c0a5-cce7-4a1e-bc34-ab11a66f7abb tempest-VolumesActionsTest-2025569969 None] Lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:11:44 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e83cf2-f25e-446a-9d37-0da24eee815f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:11:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:44 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 Jul 09 03:11:44 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Acquiring lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:11:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:11:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Acquiring lock "cinder-quobyte-c98a1fff-a76a-48ae-8072-d839e43f5018" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:11:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Lock "cinder-quobyte-c98a1fff-a76a-48ae-8072-d839e43f5018" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:11:45 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[904e53b6-3bbf-4d28-8f62-8a2f87c9593d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:11:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:45 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018 Jul 09 03:11:45 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:45 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531" returned: 0 in 1.577s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.fe9ef436-11a0-45ae-b57a-9faa1488ba86e9fafp5k.img {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:45 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.fe9ef436-11a0-45ae-b57a-9faa1488ba86e9fafp5k.img Jul 09 03:11:45 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:46 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018" returned: 0 in 1.610s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:47 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018 Jul 09 03:11:47 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:49 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c98a1fff-a76a-48ae-8072-d839e43f5018" returned: 0 in 2.166s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Lock "cinder-quobyte-c98a1fff-a76a-48ae-8072-d839e43f5018" released by "delete_volume" :: held 3.871s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:11:49 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Created reservations ['178f9785-69ac-4231-94ad-32154ba30b4d', '70d7a816-6e4c-4595-97d4-70e534c0f314', 'eec4c76e-8c4d-4edb-bb74-9dff5139bd80', '3d3e867b-e640-47d6-98e0-354b5feb6348'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:11:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:11:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:11:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:11:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:11:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:11:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:49 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:11:49 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:51 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 2.053s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:51 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:11:51 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Deleted volume successfully. Jul 09 03:11:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed6a07fa-a64e-4d73-8d3a-e100a6a64f7b tempest-VolumesActionsTest-2025569969 None] Lock "cinder-c98a1fff-a76a-48ae-8072-d839e43f5018-delete_volume" released by "delete_volume" :: held 6.516s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:11:54 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.fe9ef436-11a0-45ae-b57a-9faa1488ba86e9fafp5k.img" returned: 0 in 8.971s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:54 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ccb1a0-3187-4d9d-a970-2499f26e1f26]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:11:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:11:54 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 Jul 09 03:11:55 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:11:55 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 09 03:11:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531" returned: 0 in 1.061s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:11:55 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531, size 1024.00 MB, duration 8.97 sec, destination /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.fe9ef436-11a0-45ae-b57a-9faa1488ba86e9fafp5k.img {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:11:55 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] Converted 1024.00 MB image at 114.14 MB/s Jul 09 03:11:55 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] fe9ef436-11a0-45ae-b57a-9faa1488ba86 was raw, no need to convert to raw {{(pid=87216) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 09 03:11:59 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=31,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (35d99d9c-b8b7-42e6-9e5c-9ae03ba2dba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1441a07-d315-469c-bc28-cff9e7ecd554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1441a07-d315-469c-bc28-cff9e7ecd554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1503976411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2708dd-9e58-4c72-a956-7631804de4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:12:00Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3eda2c2-e357-4b54-ae21-d189b7de3ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3eda2c2-e357-4b54-ae21-d189b7de3ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d63e237-7574-43ca-99af-36759dded97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d63e237-7574-43ca-99af-36759dded97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2708dd-9e58-4c72-a956-7631804de4ad', 'volume_name': 'volume-6f2708dd-9e58-4c72-a956-7631804de4ad', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9624f204-044a-48cb-9646-c411511a938a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9624f204-044a-48cb-9646-c411511a938a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b732fb1c-919a-4d18-a15a-95d2a6bcf354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:00 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Volume 6f2708dd-9e58-4c72-a956-7631804de4ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2708dd-9e58-4c72-a956-7631804de4ad', 'volume_size': 1} Jul 09 03:12:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:05 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=40,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:12:10 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:12:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-a5c97852-2a28-430c-a137-a8ffe4d68faf req-17c62582-7386-4ebb-b4ec-54513453b337 tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:12:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:13 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:12:13 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:14 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.924s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:12:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:12:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:12:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.434s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] Uploaded volume to glance image-id: fe9ef436-11a0-45ae-b57a-9faa1488ba86. {{(pid=87216) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.028s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1503976411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2708dd-9e58-4c72-a956-7631804de4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:12:00Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Creating volume 6f2708dd-9e58-4c72-a956-7631804de4ad {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:12:18 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:12:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:18 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad 1073741824 Jul 09 03:12:18 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:18 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8956fa0c-7383-4fed-be51-ace3336ce3a4 tempest-VolumesActionsTest-1067442179 None] Copy volume to image completed successfully. Jul 09 03:12:19 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad 1073741824" returned: 0 in 0.827s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:19 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad Jul 09 03:12:19 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:19 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad" returned: 0 in 0.661s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-a5c97852-2a28-430c-a137-a8ffe4d68faf req-17c62582-7386-4ebb-b4ec-54513453b337 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.279s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b732fb1c-919a-4d18-a15a-95d2a6bcf354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2708dd-9e58-4c72-a956-7631804de4ad', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb40d4d6-99b4-431b-a6bb-ec21a0c7fe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21265ca-bf22-418a-95aa-47538659236d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-a5c97852-2a28-430c-a137-a8ffe4d68faf req-17c62582-7386-4ebb-b4ec-54513453b337 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:19 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Volume volume-6f2708dd-9e58-4c72-a956-7631804de4ad (6f2708dd-9e58-4c72-a956-7631804de4ad): created successfully Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb40d4d6-99b4-431b-a6bb-ec21a0c7fe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (35d99d9c-b8b7-42e6-9e5c-9ae03ba2dba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:12:19 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-62302342-70ca-49cf-bbd6-abe59408ad61 tempest-VolumesActionsTest-2025569969 None] Created volume successfully. Jul 09 03:12:19 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d Jul 09 03:12:19 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Acquiring lock "cinder-6f2708dd-9e58-4c72-a956-7631804de4ad-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Lock "cinder-6f2708dd-9e58-4c72-a956-7631804de4ad-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Acquiring lock "cinder-quobyte-6f2708dd-9e58-4c72-a956-7631804de4ad" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Lock "cinder-quobyte-6f2708dd-9e58-4c72-a956-7631804de4ad" acquired by "delete_volume" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6fbaf5-b566-4524-8fa9-4459d1766b00]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:20 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad Jul 09 03:12:20 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:20 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-a5c97852-2a28-430c-a137-a8ffe4d68faf req-17c62582-7386-4ebb-b4ec-54513453b337 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d" returned: 0 in 0.781s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-a5c97852-2a28-430c-a137-a8ffe4d68faf req-17c62582-7386-4ebb-b4ec-54513453b337 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.811s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.545s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41afcca-2770-45b1-b734-0064bb05beba]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-a5c97852-2a28-430c-a137-a8ffe4d68faf req-17c62582-7386-4ebb-b4ec-54513453b337 tempest-TestInstancesWithCinderVolumes-354509901 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-dd76d866-2498-41e5-81ba-cbdc22d6608d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37e590fc-45e4-4b8e-9bbe-b55d57248f75', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:12:20 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-a5c97852-2a28-430c-a137-a8ffe4d68faf req-17c62582-7386-4ebb-b4ec-54513453b337 tempest-TestInstancesWithCinderVolumes-354509901 None] attachment_update completed successfully. Jul 09 03:12:20 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 Jul 09 03:12:20 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:21 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad" returned: 0 in 0.772s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:21 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad Jul 09 03:12:21 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:21 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531" returned: 0 in 0.810s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:21 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6238c61-0de6-4a6f-93dd-a31d7ac11f97]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:21 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 Jul 09 03:12:21 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:21 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6f2708dd-9e58-4c72-a956-7631804de4ad" returned: 0 in 0.667s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Lock "cinder-quobyte-6f2708dd-9e58-4c72-a956-7631804de4ad" released by "delete_volume" :: held 1.486s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Created reservations ['e057ca17-21f4-43f9-80cb-15ac2bddc6e8', '1b250cb8-5782-4554-b905-d79cbbbd33ef', '0ec6bcd1-b4f7-4d66-8ebe-07a8ff72f318', 'e3523995-e0fe-4e9c-a5c8-2f7eabd056da'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:22 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:12:22 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:22 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531" returned: 0 in 0.786s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:22 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img Jul 09 03:12:22 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:22 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.711s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:12:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Deleted volume successfully. Jul 09 03:12:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-46b6c5f7-6ee2-4d7b-86f0-041ead1b8a5c tempest-VolumesActionsTest-558706093 None] Lock "cinder-6f2708dd-9e58-4c72-a956-7631804de4ad-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (564bc043-ef2d-4303-8deb-702b92971edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfc4f65-d12b-4ae0-985d-a1215664420a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfc4f65-d12b-4ae0-985d-a1215664420a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1321645015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc68ab0-c184-4a66-8990-141edeb5d5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:12:24Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71280590-a718-45c8-9eb7-05b732d608cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71280590-a718-45c8-9eb7-05b732d608cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416d3570-f895-4c63-a7be-e875334bc2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416d3570-f895-4c63-a7be-e875334bc2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc68ab0-c184-4a66-8990-141edeb5d5f9', 'volume_name': 'volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207d6e22-a5da-456b-8e19-229d906036b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207d6e22-a5da-456b-8e19-229d906036b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27721840-da6d-4193-862d-d81f6e4c18b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:24 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Volume 4dc68ab0-c184-4a66-8990-141edeb5d5f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9', 'volume_size': 1} Jul 09 03:12:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:28 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img" returned: 0 in 5.748s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:28 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f578bf8f-963b-4e3d-8767-b738294c6b8b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:28 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-87bc3399-be24-4f88-aaaf-94685fba5fed req-ae313803-a452-4ccd-960e-ce7f8fc844f2 tempest-AttachVolumeTestJSON-1708502489 None] Terminate volume connection completed successfully. Jul 09 03:12:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-87bc3399-be24-4f88-aaaf-94685fba5fed req-ae313803-a452-4ccd-960e-ce7f8fc844f2 tempest-AttachVolumeTestJSON-1708502489 None] Deleting attachment 42a084ec-a1c3-47f9-835a-a1c8b7bd01d2. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:12:28 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 Jul 09 03:12:28 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:29 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531" returned: 0 in 0.965s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:29 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:12:29 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Converted 1024.00 MB image at 178.08 MB/s Jul 09 03:12:29 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] 30c3dded-c1b5-4ac3-ab26-f01c6464d8c0 was raw, converting to qcow2 {{(pid=87216) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 09 03:12:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e712f8-236d-490b-899a-9a303f28f69c]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:29 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img Jul 09 03:12:29 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-1a329a9f-79e4-4eea-b264-be0e820d1617 req-74670638-683d-47a5-bc42-a5289b705ae5 tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:29 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img" returned: 0 in 0.771s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:29 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img Jul 09 03:12:29 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:30 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img" returned: 1 in 0.737s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:12:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img /opt/stack/data/cinder/conversion/vol_upload_6lgi3g92 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:30 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img /opt/stack/data/cinder/conversion/vol_upload_6lgi3g92 Jul 09 03:12:30 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:31 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img /opt/stack/data/cinder/conversion/vol_upload_6lgi3g92" returned: 0 in 0.663s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:31 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Image conversion details: src /opt/stack/data/cinder/conversion/6d20f2af-fadd-41be-a572-fd9c2d7d9531.temp_image.30c3dded-c1b5-4ac3-ab26-f01c6464d8c0sas_gmk1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_6lgi3g92 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:12:31 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 09 03:12:31 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c33ca7-7d5f-48d3-a988-4817a7c309ec]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6lgi3g92 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:31 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6lgi3g92 Jul 09 03:12:31 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:31 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6lgi3g92" returned: 0 in 0.739s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.648s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Uploaded volume to glance image-id: 30c3dded-c1b5-4ac3-ab26-f01c6464d8c0. {{(pid=87216) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.108s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1321645015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc68ab0-c184-4a66-8990-141edeb5d5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:12:24Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Creating volume 4dc68ab0-c184-4a66-8990-141edeb5d5f9 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:12:33 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:12:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:33 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9 1073741824 Jul 09 03:12:33 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:33 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c68050b1-0623-4b7f-b10c-48f3c3ad7ce2 tempest-VolumesActionsTest-1067442179 None] Copy volume to image completed successfully. Jul 09 03:12:34 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9 1073741824" returned: 0 in 0.903s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:34 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9 Jul 09 03:12:34 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Acquiring lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Acquiring lock "cinder-quobyte-6d20f2af-fadd-41be-a572-fd9c2d7d9531" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Lock "cinder-quobyte-6d20f2af-fadd-41be-a572-fd9c2d7d9531" acquired by "delete_volume" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:34 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[709daac7-7997-4325-bdeb-04c54d0e61e0]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:34 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 Jul 09 03:12:34 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:35 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9" returned: 0 in 0.747s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-1a329a9f-79e4-4eea-b264-be0e820d1617 req-74670638-683d-47a5-bc42-a5289b705ae5 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.555s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27721840-da6d-4193-862d-d81f6e4c18b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9f33ea-37cd-4109-bdda-d490d6357392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2583e4f-8b5b-4b79-b1e2-81f5f02c5e20]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-1a329a9f-79e4-4eea-b264-be0e820d1617 req-74670638-683d-47a5-bc42-a5289b705ae5 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:35 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Volume volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9 (4dc68ab0-c184-4a66-8990-141edeb5d5f9): created successfully Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9f33ea-37cd-4109-bdda-d490d6357392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (564bc043-ef2d-4303-8deb-702b92971edd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:12:35 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4d3783aa-26a6-4096-b87c-df74d094ca13 tempest-VolumesActionsTest-2025569969 None] Created volume successfully. Jul 09 03:12:35 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c Jul 09 03:12:35 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:35 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531" returned: 0 in 0.821s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:35 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531 Jul 09 03:12:35 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Acquiring lock "cinder-4dc68ab0-c184-4a66-8990-141edeb5d5f9-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Lock "cinder-4dc68ab0-c184-4a66-8990-141edeb5d5f9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Acquiring lock "cinder-quobyte-4dc68ab0-c184-4a66-8990-141edeb5d5f9" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Lock "cinder-quobyte-4dc68ab0-c184-4a66-8990-141edeb5d5f9" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[448c9a53-3690-4011-bc9d-835737931cb1]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:35 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-1a329a9f-79e4-4eea-b264-be0e820d1617 req-74670638-683d-47a5-bc42-a5289b705ae5 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c" returned: 0 in 0.862s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-1a329a9f-79e4-4eea-b264-be0e820d1617 req-74670638-683d-47a5-bc42-a5289b705ae5 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.903s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-1a329a9f-79e4-4eea-b264-be0e820d1617 req-74670638-683d-47a5-bc42-a5289b705ae5 tempest-TestInstancesWithCinderVolumes-354509901 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56f1f61a-2ebe-4c26-aacd-88494df0c0ee', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:12:35 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9 Jul 09 03:12:35 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:36 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-1a329a9f-79e4-4eea-b264-be0e820d1617 req-74670638-683d-47a5-bc42-a5289b705ae5 tempest-TestInstancesWithCinderVolumes-354509901 None] attachment_update completed successfully. Jul 09 03:12:36 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-6d20f2af-fadd-41be-a572-fd9c2d7d9531" returned: 0 in 0.752s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Lock "cinder-quobyte-6d20f2af-fadd-41be-a572-fd9c2d7d9531" released by "delete_volume" :: held 1.616s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:36 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Created reservations ['6a3d57a1-df8e-48f6-8dd7-02c904cc1036', 'c6f5dee6-83f1-4b90-a205-ceae5749bac7', '163263e3-7a77-4fd5-8c8d-4e56d65107af', '4cb361e2-dd05-45b3-bdf7-a54e1336877a'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:12:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:36 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:12:36 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:36 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9" returned: 0 in 0.901s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:36 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9 Jul 09 03:12:36 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:37 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.915s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:12:37 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Deleted volume successfully. Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e88d80b-5a58-47ab-b1e0-6822f1e69afa tempest-VolumesActionsTest-1067442179 None] Lock "cinder-6d20f2af-fadd-41be-a572-fd9c2d7d9531-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:37 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4dc68ab0-c184-4a66-8990-141edeb5d5f9" returned: 0 in 0.965s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Lock "cinder-quobyte-4dc68ab0-c184-4a66-8990-141edeb5d5f9" released by "delete_volume" :: held 1.954s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Created reservations ['d6c6280f-dcb7-440c-8cb3-dae5cca78a70', '9049897f-03eb-48e1-bb48-aa1cc0e2ac84', 'f6977ef2-0f1b-425a-8d51-2a7e22df6c69', '910fc0ed-9e65-4c0c-a008-bdf4c415a4d9'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:38 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:12:38 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:38 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.742s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:38 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:12:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Deleted volume successfully. Jul 09 03:12:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-709a85b1-50b0-47b2-a70d-e1a5cb7111f6 tempest-VolumesActionsTest-558706093 None] Lock "cinder-4dc68ab0-c184-4a66-8990-141edeb5d5f9-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (23cbff82-ab57-40a0-a187-c5ed897a3494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9b884d-1e97-4f74-9416-423bc39d1fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9b884d-1e97-4f74-9416-423bc39d1fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1785350403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4105616f-7bf7-4adf-ba3d-73e0a89f4bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:12:40Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af274e0-c321-45e5-aa04-7090580b472c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af274e0-c321-45e5-aa04-7090580b472c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87722aac-0136-4169-96b2-291a09857184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87722aac-0136-4169-96b2-291a09857184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4105616f-7bf7-4adf-ba3d-73e0a89f4bba', 'volume_name': 'volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955cd119-618b-4c67-ae1c-733513a1144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955cd119-618b-4c67-ae1c-733513a1144c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ecd5ee-b407-48db-8fae-3c7d64b59e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:39 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Volume 4105616f-7bf7-4adf-ba3d-73e0a89f4bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba', 'volume_size': 1} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1785350403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4105616f-7bf7-4adf-ba3d-73e0a89f4bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:12:40Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Creating volume 4105616f-7bf7-4adf-ba3d-73e0a89f4bba {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:12:39 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:12:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:39 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba 1073741824 Jul 09 03:12:39 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:41 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba 1073741824" returned: 0 in 1.415s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:41 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba Jul 09 03:12:41 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:42 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba" returned: 0 in 1.286s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] <== create_volume: return (2797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:12:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.800s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ecd5ee-b407-48db-8fae-3c7d64b59e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818ad49e-d7c4-434f-962b-c0341e086193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:42 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Volume volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba (4105616f-7bf7-4adf-ba3d-73e0a89f4bba): created successfully Jul 09 03:12:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818ad49e-d7c4-434f-962b-c0341e086193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (23cbff82-ab57-40a0-a187-c5ed897a3494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:12:42 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-dbb3f84c-ff2b-41bd-94f6-0e04dd2641f6 tempest-VolumesActionsTest-2025569969 None] Created volume successfully. Jul 09 03:12:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Acquiring lock "cinder-4105616f-7bf7-4adf-ba3d-73e0a89f4bba-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Lock "cinder-4105616f-7bf7-4adf-ba3d-73e0a89f4bba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Acquiring lock "cinder-quobyte-4105616f-7bf7-4adf-ba3d-73e0a89f4bba" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Lock "cinder-quobyte-4105616f-7bf7-4adf-ba3d-73e0a89f4bba" acquired by "delete_volume" :: waited 0.067s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:43 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[848d639b-751e-44c8-a707-047a6e0b6896]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:43 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba Jul 09 03:12:43 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:44 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba" returned: 0 in 1.286s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:44 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba Jul 09 03:12:44 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:45 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4105616f-7bf7-4adf-ba3d-73e0a89f4bba" returned: 0 in 0.950s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Lock "cinder-quobyte-4105616f-7bf7-4adf-ba3d-73e0a89f4bba" released by "delete_volume" :: held 2.331s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:45 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Created reservations ['9dffe7b5-f05d-45f2-a659-e682489da395', 'dcdce4da-e3c8-4d00-a2e3-1d9da1db973f', '695371a0-bc96-4bb6-a5c3-8d1150383656', '6cc9ca2c-72ac-4334-be0f-3238d4b39e83'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:12:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:45 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:12:45 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:46 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.792s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:46 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:12:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Deleted volume successfully. Jul 09 03:12:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b1dffc7-ed30-41ac-a818-5cc6b5c62e33 tempest-VolumesActionsTest-558706093 None] Lock "cinder-4105616f-7bf7-4adf-ba3d-73e0a89f4bba-delete_volume" released by "delete_volume" :: held 3.451s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-d98b9b27-b820-4f0a-9b17-913728a89472 req-06284955-a7c2-4162-bb8f-20e787187053 tempest-TestInstancesWithCinderVolumes-354509901 None] Terminate volume connection completed successfully. Jul 09 03:12:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-d98b9b27-b820-4f0a-9b17-913728a89472 req-06284955-a7c2-4162-bb8f-20e787187053 tempest-TestInstancesWithCinderVolumes-354509901 None] Deleting attachment 37e590fc-45e4-4b8e-9bbe-b55d57248f75. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (74735559-9b9b-4be5-925d-4bc3814010d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d204aea-b7cd-4683-aa40-631ed858a630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d204aea-b7cd-4683-aa40-631ed858a630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1370186526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad92525-bb41-4122-ba46-cc48a10ed2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:12:47Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a7576d-9697-4a1c-8684-b4afc75881b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a7576d-9697-4a1c-8684-b4afc75881b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bdfe5c-ec08-4ec6-86be-f159539ed53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bdfe5c-ec08-4ec6-86be-f159539ed53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad92525-bb41-4122-ba46-cc48a10ed2fb', 'volume_name': 'volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d4e6fc-80b4-49b5-9f93-3bee373059c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d4e6fc-80b4-49b5-9f93-3bee373059c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa2875a-d007-491f-92a4-df337ed73f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:47 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Volume 5ad92525-bb41-4122-ba46-cc48a10ed2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb', 'volume_size': 1} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1370186526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad92525-bb41-4122-ba46-cc48a10ed2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:12:47Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Creating volume 5ad92525-bb41-4122-ba46-cc48a10ed2fb {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:12:47 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:12:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:47 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb 1073741824 Jul 09 03:12:47 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:48 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb 1073741824" returned: 0 in 0.953s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:48 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb Jul 09 03:12:48 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "cinder-dd76d866-2498-41e5-81ba-cbdc22d6608d-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-dd76d866-2498-41e5-81ba-cbdc22d6608d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "cinder-quobyte-dd76d866-2498-41e5-81ba-cbdc22d6608d" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-quobyte-dd76d866-2498-41e5-81ba-cbdc22d6608d" acquired by "delete_volume" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:49 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2e3878-cc51-48c4-b53f-d0218ecb561b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:49 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d Jul 09 03:12:49 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:49 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb" returned: 0 in 1.222s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:12:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa2875a-d007-491f-92a4-df337ed73f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1e6e43-3603-4eb1-8f6f-780ec35713d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:49 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Volume volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb (5ad92525-bb41-4122-ba46-cc48a10ed2fb): created successfully Jul 09 03:12:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1e6e43-3603-4eb1-8f6f-780ec35713d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (74735559-9b9b-4be5-925d-4bc3814010d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:12:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-adc218b7-c3a4-45b2-aa30-aef407e1e176 tempest-VolumesActionsTest-2025569969 None] Created volume successfully. Jul 09 03:12:50 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d" returned: 0 in 1.068s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:50 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d Jul 09 03:12:50 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:51 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-dd76d866-2498-41e5-81ba-cbdc22d6608d" returned: 0 in 0.912s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-quobyte-dd76d866-2498-41e5-81ba-cbdc22d6608d" released by "delete_volume" :: held 2.061s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Acquiring lock "cinder-5ad92525-bb41-4122-ba46-cc48a10ed2fb-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Lock "cinder-5ad92525-bb41-4122-ba46-cc48a10ed2fb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:51 devstack cinder-volume[87216]: WARNING cinder.quota [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-488307653-2062463858 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-488307653-2062463858, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:12:51 devstack cinder-volume[87216]: WARNING cinder.quota [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-488307653-2062463858 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-488307653-2062463858, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Acquiring lock "cinder-quobyte-5ad92525-bb41-4122-ba46-cc48a10ed2fb" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Lock "cinder-quobyte-5ad92525-bb41-4122-ba46-cc48a10ed2fb" acquired by "delete_volume" :: waited 0.036s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Created reservations ['6917f7f3-fd1a-4414-8422-d6041679d87c', 'ebea6694-89f5-4b50-8d62-0826a26c2693', '0d0296de-abe9-4238-8188-f08d530b50fe', 'e6568176-c500-40a7-a0fd-e7013bffde34'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[093136cd-9d68-427d-a7bb-20c3a37697fe]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:51 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:12:51 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:51 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb Jul 09 03:12:51 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:52 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.005s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:52 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:12:52 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Deleted volume successfully. Jul 09 03:12:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-728327e7-6f9c-437a-a43c-0d1f3966d998 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-dd76d866-2498-41e5-81ba-cbdc22d6608d-delete_volume" released by "delete_volume" :: held 3.546s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:52 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb" returned: 0 in 1.544s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:52 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb Jul 09 03:12:52 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:53 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5ad92525-bb41-4122-ba46-cc48a10ed2fb" returned: 0 in 0.834s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Lock "cinder-quobyte-5ad92525-bb41-4122-ba46-cc48a10ed2fb" released by "delete_volume" :: held 2.429s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:53 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Created reservations ['aba1103c-0081-4caa-ae83-f139474ae6f2', 'dd5f51ff-0468-476e-b831-311a964cc1a5', 'cef67e53-b40b-46e3-9ec5-96b772c47bfb', '1249c984-31a3-4002-904a-0386edbdd478'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:12:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:53 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:12:53 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:54 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.796s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:54 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:12:54 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Deleted volume successfully. Jul 09 03:12:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f9fc2eb6-2606-451c-b0c9-7b62dee14a43 tempest-VolumesActionsTest-558706093 None] Lock "cinder-5ad92525-bb41-4122-ba46-cc48a10ed2fb-delete_volume" released by "delete_volume" :: held 3.578s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-6c7b9a4e-75a8-4d61-b861-38b14a641c65 req-711951fc-b98d-4638-94cf-c2caf1b673dc tempest-TestInstancesWithCinderVolumes-354509901 None] Terminate volume connection completed successfully. Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-6c7b9a4e-75a8-4d61-b861-38b14a641c65 req-711951fc-b98d-4638-94cf-c2caf1b673dc tempest-TestInstancesWithCinderVolumes-354509901 None] Deleting attachment 56f1f61a-2ebe-4c26-aacd-88494df0c0ee. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (400b00c6-2033-40c5-a297-e3d163d7dc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044611ff-7682-471f-a704-c109b6740ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044611ff-7682-471f-a704-c109b6740ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-999967524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b1d6de-38c7-4f27-b65d-414f96933f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:12:55Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a963bc43-dda2-414b-a343-f3828b80cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a963bc43-dda2-414b-a343-f3828b80cf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbd6560-2a14-4233-b107-4fd65423d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbd6560-2a14-4233-b107-4fd65423d28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b1d6de-38c7-4f27-b65d-414f96933f3d', 'volume_name': 'volume-19b1d6de-38c7-4f27-b65d-414f96933f3d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd6893c-912f-43ed-b0d2-22b317c73ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd6893c-912f-43ed-b0d2-22b317c73ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa500563-edfc-44aa-9fa3-bc9b740bb078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:55 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Volume 19b1d6de-38c7-4f27-b65d-414f96933f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b1d6de-38c7-4f27-b65d-414f96933f3d', 'volume_size': 1} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-999967524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b1d6de-38c7-4f27-b65d-414f96933f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e0368fd1c341299097d7b0742f9df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:12:55Z,use_quota=True,user_id='83a99ee136cb49d88c7e08b77fba7873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Creating volume 19b1d6de-38c7-4f27-b65d-414f96933f3d {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:12:55 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:12:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:55 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d 1073741824 Jul 09 03:12:55 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:56 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d 1073741824" returned: 0 in 0.996s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:56 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d Jul 09 03:12:56 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "cinder-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "cinder-quobyte-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-quobyte-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c" acquired by "delete_volume" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fc7694-8a44-4cbe-9bde-010c0e029b3b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:57 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d" returned: 0 in 0.744s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa500563-edfc-44aa-9fa3-bc9b740bb078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b1d6de-38c7-4f27-b65d-414f96933f3d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67feff43-5297-4cb4-a5c5-d52409b0eebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:12:57 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Volume volume-19b1d6de-38c7-4f27-b65d-414f96933f3d (19b1d6de-38c7-4f27-b65d-414f96933f3d): created successfully Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67feff43-5297-4cb4-a5c5-d52409b0eebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:12:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Flow 'volume_create_manager' (400b00c6-2033-40c5-a297-e3d163d7dc4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:12:57 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c Jul 09 03:12:57 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:57 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-e908c15e-f609-459e-bc04-970d488df8eb tempest-VolumesActionsTest-2025569969 None] Created volume successfully. Jul 09 03:12:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Acquiring lock "cinder-19b1d6de-38c7-4f27-b65d-414f96933f3d-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:58 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c" returned: 0 in 1.209s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Lock "cinder-19b1d6de-38c7-4f27-b65d-414f96933f3d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:58 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c Jul 09 03:12:58 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Acquiring lock "cinder-quobyte-19b1d6de-38c7-4f27-b65d-414f96933f3d" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:12:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Lock "cinder-quobyte-19b1d6de-38c7-4f27-b65d-414f96933f3d" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:12:58 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[087ec9a8-56cb-4bc9-b4d8-822fb7f94275]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:12:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:58 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d Jul 09 03:12:58 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:59 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c" returned: 0 in 0.945s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-quobyte-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c" released by "delete_volume" :: held 2.221s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:12:59 devstack cinder-volume[87216]: WARNING cinder.quota [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1617281310-1632320201 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1617281310-1632320201, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:12:59 devstack cinder-volume[87216]: WARNING cinder.quota [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1617281310-1632320201 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1617281310-1632320201, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:12:59 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Created reservations ['e201e3f1-57ac-4eb8-b478-cd13d2447308', '04d15093-fb12-45f5-b628-9c214ed060fa', '780b7c15-b9de-4103-90de-f8395a03cbca', '327ae053-cbf5-4ea8-87e3-c7f15cd0996c'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:12:59 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 09 03:12:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d" returned: 0 in 1.007s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:12:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:12:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:12:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:12:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:12:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:12:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:12:59 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d Jul 09 03:12:59 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:12:59 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:12:59 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:00 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:00 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-19b1d6de-38c7-4f27-b65d-414f96933f3d" returned: 0 in 1.045s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.015s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:13:00 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Deleted volume successfully. Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Lock "cinder-quobyte-19b1d6de-38c7-4f27-b65d-414f96933f3d" released by "delete_volume" :: held 2.160s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-11e8cc2c-53db-4a4d-9d16-38895e4ef8eb tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-56e9e1c6-03a1-46a6-9a1c-a11c08bc345c-delete_volume" released by "delete_volume" :: held 3.686s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Created reservations ['c81b8931-5362-4ead-a71c-64df771a7d7b', '15d99df2-e077-4f4c-a259-9a53291d494d', '9d9ca6df-e39d-4987-b594-5daedca3553d', '72a6d514-e881-424c-a902-72d36ddd1069'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:00 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:13:00 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:01 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.716s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:13:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Deleted volume successfully. Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Flow 'volume_create_manager' (7eab6674-14c7-4101-8ca6-8a3a7d7156bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5913da74-5ca9-494f-8a04-00c8d9058315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6a143195-da06-49a1-9072-5afccc33ab5a tempest-VolumesActionsTest-2025569969 None] Lock "cinder-19b1d6de-38c7-4f27-b65d-414f96933f3d-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5913da74-5ca9-494f-8a04-00c8d9058315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1979750370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b112d33-1182-426b-a6af-23dda8b449d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3a8b067dc143d1a800e652b5ef8de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:02Z,use_quota=True,user_id='4921cf41f94d4900b356a98e13c69675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c50a07e-80eb-422f-a58d-67fc3c4874e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c50a07e-80eb-422f-a58d-67fc3c4874e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d83f1e-46f0-4057-939c-44658b4479b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d83f1e-46f0-4057-939c-44658b4479b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b112d33-1182-426b-a6af-23dda8b449d4', 'volume_name': 'volume-8b112d33-1182-426b-a6af-23dda8b449d4', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d23d637-3108-46b6-907c-0c9070c768a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d23d637-3108-46b6-907c-0c9070c768a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b1165e-8df8-4066-946a-e93db324e4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:01 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Volume 8b112d33-1182-426b-a6af-23dda8b449d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b112d33-1182-426b-a6af-23dda8b449d4', 'volume_size': 1} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1979750370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b112d33-1182-426b-a6af-23dda8b449d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3a8b067dc143d1a800e652b5ef8de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:02Z,use_quota=True,user_id='4921cf41f94d4900b356a98e13c69675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Creating volume 8b112d33-1182-426b-a6af-23dda8b449d4 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:13:01 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:13:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:01 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 1073741824 Jul 09 03:13:01 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:03 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 1073741824" returned: 0 in 1.390s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:03 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 Jul 09 03:13:03 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:04 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4" returned: 0 in 0.811s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:13:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b1165e-8df8-4066-946a-e93db324e4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b112d33-1182-426b-a6af-23dda8b449d4', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c79ed49-c955-4468-9aa7-51bbb0691edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:04 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Volume volume-8b112d33-1182-426b-a6af-23dda8b449d4 (8b112d33-1182-426b-a6af-23dda8b449d4): created successfully Jul 09 03:13:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c79ed49-c955-4468-9aa7-51bbb0691edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Flow 'volume_create_manager' (7eab6674-14c7-4101-8ca6-8a3a7d7156bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:04 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-41ce9ca0-d289-4f91-a3c7-c50ee1af78df tempest-VolumesSnapshotTestJSON-1900569846 None] Created volume successfully. Jul 09 03:13:05 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-15fa5209-c2d4-4e19-bbad-bb540f17d18f req-6edb1347-0ccb-4ec1-b861-c7b7d0492fed tempest-TestInstancesWithCinderVolumes-354509901 None] Terminate volume connection completed successfully. Jul 09 03:13:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-15fa5209-c2d4-4e19-bbad-bb540f17d18f req-6edb1347-0ccb-4ec1-b861-c7b7d0492fed tempest-TestInstancesWithCinderVolumes-354509901 None] Deleting attachment 30e1aeed-02a1-4fd1-9772-f78ea57edd02. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:13:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] Creating offline snapshot 35a70c20-327f-4619-8a95-f5f8d1e581f7 of volume 8b112d33-1182-426b-a6af-23dda8b449d4 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:13:05 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d587a79-c583-446f-a178-d9c598bc3385]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:05 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 Jul 09 03:13:05 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:06 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4" returned: 0 in 1.048s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:06 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 1G Jul 09 03:13:06 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:07 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 1G" returned: 0 in 1.043s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b112d33-1182-426b-a6af-23dda8b449d4 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:07 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b112d33-1182-426b-a6af-23dda8b449d4 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 Jul 09 03:13:07 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:08 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b112d33-1182-426b-a6af-23dda8b449d4 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7" returned: 0 in 0.928s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:08 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 is being set with open permissions: ugo+rw Jul 09 03:13:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:08 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 Jul 09 03:13:08 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "cinder-2be72e67-cbc6-4d8e-ab40-a70562f1101b-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-2be72e67-cbc6-4d8e-ab40-a70562f1101b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:09 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=69,cinder:UPDATE=89,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:13:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "cinder-quobyte-2be72e67-cbc6-4d8e-ab40-a70562f1101b" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-quobyte-2be72e67-cbc6-4d8e-ab40-a70562f1101b" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:09 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[10709065-4982-4e56-90b3-2b4012c59bbd]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:09 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b Jul 09 03:13:09 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:09 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7" returned: 0 in 0.936s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:09 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.info Jul 09 03:13:09 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:10 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b" returned: 0 in 0.808s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:10 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b Jul 09 03:13:10 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:10 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.info" returned: 0 in 0.779s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:10 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.info is being set with open permissions: ugo+rw Jul 09 03:13:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:10 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.info Jul 09 03:13:10 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:11 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.info" returned: 0 in 0.810s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.704s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:11 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b" returned: 1 in 1.052s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:13:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:11 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b Jul 09 03:13:11 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:11 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=76,cinder:UPDATE=86,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:13:11 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1d3dd3b5-920e-4a01-aa47-fadfd78b6a28 tempest-VolumesSnapshotTestJSON-1900569846 None] Create snapshot completed successfully Jul 09 03:13:11 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2be72e67-cbc6-4d8e-ab40-a70562f1101b" returned: 0 in 0.799s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-quobyte-2be72e67-cbc6-4d8e-ab40-a70562f1101b" released by "delete_volume" :: held 2.802s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:11 devstack cinder-volume[87216]: WARNING cinder.quota [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453189953-725410963 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453189953-725410963, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:13:11 devstack cinder-volume[87216]: WARNING cinder.quota [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453189953-725410963 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453189953-725410963, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:13:11 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Created reservations ['f1b1f7c5-a102-48d1-9342-23688f15872d', 'bf973626-75f0-450a-a9f9-3c44f2ac6500', '6c79270a-9713-401e-afb1-3ca87302a41c', '46768b27-aa83-4c5f-81f4-86dae2181a16'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-35a70c20-327f-4619-8a95-f5f8d1e581f7-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-35a70c20-327f-4619-8a95-f5f8d1e581f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:12 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:13:12 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-8b112d33-1182-426b-a6af-23dda8b449d4" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-8b112d33-1182-426b-a6af-23dda8b449d4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-35a70c20-327f-4619-8a95-f5f8d1e581f7" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-35a70c20-327f-4619-8a95-f5f8d1e581f7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Deleting offline snapshot 35a70c20-327f-4619-8a95-f5f8d1e581f7 of volume 8b112d33-1182-426b-a6af-23dda8b449d4 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] snapshot_file for this snap is: volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5382128c-bb49-4ce1-9db1-51625d96238e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:12 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 Jul 09 03:13:12 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:13 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.928s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:13:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Deleted volume successfully. Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a63f5725-d27b-4a0e-a4f1-57a9c4e13a26 tempest-TestInstancesWithCinderVolumes-354509901 None] Lock "cinder-2be72e67-cbc6-4d8e-ab40-a70562f1101b-delete_volume" released by "delete_volume" :: held 4.072s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:13 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7" returned: 0 in 1.159s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b112d33-1182-426b-a6af-23dda8b449d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7c508c-c5f9-4acd-bafb-295d90bea861]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:13 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 Jul 09 03:13:13 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:13 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:13:13 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:14 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4" returned: 0 in 0.959s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:14 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 Jul 09 03:13:14 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:14 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.923s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:13:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:13:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:13:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:13:15 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7" returned: 0 in 1.183s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:15 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7 Jul 09 03:13:15 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:16 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4.35a70c20-327f-4619-8a95-f5f8d1e581f7" returned: 0 in 0.830s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-35a70c20-327f-4619-8a95-f5f8d1e581f7" released by "_delete_snapshot" :: held 4.299s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-8b112d33-1182-426b-a6af-23dda8b449d4" released by "delete_snapshot" :: held 4.334s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:16 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Created reservations ['c96b22eb-0ffc-4db2-ae8d-e9b3d3c41790', 'd062f975-aa84-44bb-b5c7-2d40aaa0491e', '5c5688e4-c9a1-410b-9716-4bc95d256a4c', '6251870b-8364-4e5c-b30c-63902a27b75d'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:13:16 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Delete snapshot completed successfully. Jul 09 03:13:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-67082c42-cb07-4b3c-b30b-a7726b574caf tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-35a70c20-327f-4619-8a95-f5f8d1e581f7-delete_snapshot" released by "delete_snapshot" :: held 4.634s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Flow 'volume_create_manager' (472f291b-4238-4da5-8adf-ec739840af7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f583ea37-b34e-4851-8588-602e249f2b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f583ea37-b34e-4851-8588-602e249f2b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-99287951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7dda7ab-3499-4b65-ac9e-47c0905302b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffc36e3acb248e2a5aba395cb34be28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:18Z,use_quota=True,user_id='4daf53d076ae4cd2926ca874110cc99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f95034-a3f8-4089-af2d-3e4ccf5fc8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f95034-a3f8-4089-af2d-3e4ccf5fc8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a834e22-904b-4db8-b359-0f95ebaeef01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a834e22-904b-4db8-b359-0f95ebaeef01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7dda7ab-3499-4b65-ac9e-47c0905302b9', 'volume_name': 'volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d9996d-6415-4a70-a126-86e9a63ff59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d9996d-6415-4a70-a126-86e9a63ff59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666adaec-15f3-45c1-b4b0-1fd9b463e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:18 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Volume e7dda7ab-3499-4b65-ac9e-47c0905302b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9', 'volume_size': 1} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-99287951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7dda7ab-3499-4b65-ac9e-47c0905302b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffc36e3acb248e2a5aba395cb34be28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:18Z,use_quota=True,user_id='4daf53d076ae4cd2926ca874110cc99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Creating volume e7dda7ab-3499-4b65-ac9e-47c0905302b9 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:13:18 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:18 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9 1073741824 Jul 09 03:13:18 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Flow 'volume_create_manager' (aa02200f-3b43-4391-bf63-c16da6c9c703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f3efbf-dd56-461c-8b98-1be57678d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f3efbf-dd56-461c-8b98-1be57678d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1699266974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba399f55-8d64-4e0b-99e7-110d2ea9dc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3a8b067dc143d1a800e652b5ef8de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:18Z,use_quota=True,user_id='4921cf41f94d4900b356a98e13c69675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c5160d-934d-430b-ae21-c066f85518b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c5160d-934d-430b-ae21-c066f85518b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd9df7f-df00-4b6e-8bb1-afab1e66dc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd9df7f-df00-4b6e-8bb1-afab1e66dc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba399f55-8d64-4e0b-99e7-110d2ea9dc2e', 'volume_name': 'volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7231c598-149e-4339-a512-c76c276a1325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7231c598-149e-4339-a512-c76c276a1325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3e360a-3bf9-49a9-85ac-f0216559d7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:18 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Volume ba399f55-8d64-4e0b-99e7-110d2ea9dc2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e', 'volume_size': 1} Jul 09 03:13:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:19 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9 1073741824" returned: 0 in 0.993s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:19 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9 Jul 09 03:13:19 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:20 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9" returned: 0 in 0.763s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.648s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1699266974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba399f55-8d64-4e0b-99e7-110d2ea9dc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3a8b067dc143d1a800e652b5ef8de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:18Z,use_quota=True,user_id='4921cf41f94d4900b356a98e13c69675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Creating volume ba399f55-8d64-4e0b-99e7-110d2ea9dc2e {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:13:20 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666adaec-15f3-45c1-b4b0-1fd9b463e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:20 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e 1073741824 Jul 09 03:13:20 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afa9c0c-2b21-4a63-9e22-6157d6d9b8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:20 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Volume volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9 (e7dda7ab-3499-4b65-ac9e-47c0905302b9): created successfully Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afa9c0c-2b21-4a63-9e22-6157d6d9b8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Flow 'volume_create_manager' (472f291b-4238-4da5-8adf-ec739840af7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:20 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c9ef148e-be71-42ac-8747-2b900ca394bc tempest-VolumesListAdminTestJSON-1063482149 None] Created volume successfully. Jul 09 03:13:21 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e 1073741824" returned: 0 in 0.941s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:21 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e Jul 09 03:13:21 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:22 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" returned: 0 in 0.928s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3e360a-3bf9-49a9-85ac-f0216559d7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad27fc1-ec05-4502-9156-b317911e0533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:22 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Volume volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e (ba399f55-8d64-4e0b-99e7-110d2ea9dc2e): created successfully Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad27fc1-ec05-4502-9156-b317911e0533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Flow 'volume_create_manager' (aa02200f-3b43-4391-bf63-c16da6c9c703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-318e7ff4-35d3-4e47-b1f2-5be3a2eed283 tempest-VolumesSnapshotTestJSON-1900569846 None] Created volume successfully. Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Flow 'volume_create_manager' (791be0b5-b7bb-4ea1-8124-9e0f972b79d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0139d8-8f7c-4b04-b5cf-0c65933f37d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0139d8-8f7c-4b04-b5cf-0c65933f37d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1163382231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20284beb-3a61-422b-93d6-3b615464366c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffc36e3acb248e2a5aba395cb34be28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:22Z,use_quota=True,user_id='4daf53d076ae4cd2926ca874110cc99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fe0918-d8e8-41cc-9056-f6b2aebe2262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fe0918-d8e8-41cc-9056-f6b2aebe2262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7b2f49-6891-414e-9283-76d567603a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7b2f49-6891-414e-9283-76d567603a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20284beb-3a61-422b-93d6-3b615464366c', 'volume_name': 'volume-20284beb-3a61-422b-93d6-3b615464366c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541bd049-6529-4af7-81e6-da3809acdebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541bd049-6529-4af7-81e6-da3809acdebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abd4f75-2c33-4989-bf5a-0b8ef716a7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:22 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Volume 20284beb-3a61-422b-93d6-3b615464366c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20284beb-3a61-422b-93d6-3b615464366c', 'volume_size': 1} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1163382231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20284beb-3a61-422b-93d6-3b615464366c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffc36e3acb248e2a5aba395cb34be28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:22Z,use_quota=True,user_id='4daf53d076ae4cd2926ca874110cc99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Creating volume 20284beb-3a61-422b-93d6-3b615464366c {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:13:22 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:22 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c 1073741824 Jul 09 03:13:22 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:23 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c 1073741824" returned: 0 in 1.011s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:23 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c Jul 09 03:13:23 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:24 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c" returned: 0 in 0.710s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:13:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.498s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abd4f75-2c33-4989-bf5a-0b8ef716a7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20284beb-3a61-422b-93d6-3b615464366c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cae2d36-7d1f-4b45-a423-bf3c1efdfc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] Creating offline snapshot 144220e8-9bba-4320-85bd-99bd4fb84472 of volume ba399f55-8d64-4e0b-99e7-110d2ea9dc2e {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:13:24 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Volume volume-20284beb-3a61-422b-93d6-3b615464366c (20284beb-3a61-422b-93d6-3b615464366c): created successfully Jul 09 03:13:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cae2d36-7d1f-4b45-a423-bf3c1efdfc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Flow 'volume_create_manager' (791be0b5-b7bb-4ea1-8124-9e0f972b79d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:24 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1ebfcc-1537-4470-b700-eca22781f0c8]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:24 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4b32042a-d3b1-4539-8a99-76f3c85019ef tempest-VolumesListAdminTestJSON-1063482149 None] Created volume successfully. Jul 09 03:13:24 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e Jul 09 03:13:24 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:25 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" returned: 0 in 1.133s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:25 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 1G Jul 09 03:13:25 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Flow 'volume_create_manager' (8f7b554f-943d-4802-8397-c0c54543c6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223ee0bd-efc4-47df-a74a-1b9ba2f802b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223ee0bd-efc4-47df-a74a-1b9ba2f802b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1732975174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0276168f-ff72-4888-98df-6a7ef830f1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffc36e3acb248e2a5aba395cb34be28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:25Z,use_quota=True,user_id='4daf53d076ae4cd2926ca874110cc99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcd8014-e8a6-42e5-852a-249dcd0a8742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcd8014-e8a6-42e5-852a-249dcd0a8742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c0fa87-4dd8-410c-9c12-bbb6234c7d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c0fa87-4dd8-410c-9c12-bbb6234c7d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0276168f-ff72-4888-98df-6a7ef830f1bc', 'volume_name': 'volume-0276168f-ff72-4888-98df-6a7ef830f1bc', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cddfa7-847e-4737-87bb-8cd98dbe5db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cddfa7-847e-4737-87bb-8cd98dbe5db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5d3bbb-7da4-4f9b-96fe-1e2ede49b4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:25 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Volume 0276168f-ff72-4888-98df-6a7ef830f1bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0276168f-ff72-4888-98df-6a7ef830f1bc', 'volume_size': 1} Jul 09 03:13:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:26 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 1G" returned: 0 in 1.110s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:26 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 Jul 09 03:13:26 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:27 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472" returned: 0 in 0.713s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:27 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 is being set with open permissions: ugo+rw Jul 09 03:13:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:27 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 Jul 09 03:13:27 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:27 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472" returned: 0 in 0.695s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:27 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.info Jul 09 03:13:27 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:28 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.info" returned: 0 in 0.691s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:28 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.info is being set with open permissions: ugo+rw Jul 09 03:13:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:28 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.info Jul 09 03:13:28 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:29 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.info" returned: 0 in 0.707s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.188s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.685s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1732975174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0276168f-ff72-4888-98df-6a7ef830f1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffc36e3acb248e2a5aba395cb34be28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:25Z,use_quota=True,user_id='4daf53d076ae4cd2926ca874110cc99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Creating volume 0276168f-ff72-4888-98df-6a7ef830f1bc {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:13:29 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:13:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:29 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc 1073741824 Jul 09 03:13:29 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:29 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6c3334a8-f0b0-4e90-97d9-6db117471dc3 tempest-VolumesSnapshotTestJSON-1900569846 None] Create snapshot completed successfully Jul 09 03:13:30 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc 1073741824" returned: 0 in 1.180s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:30 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc Jul 09 03:13:30 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Flow 'volume_create_manager' (d5b27956-5e29-42bf-a6a6-93849e2e45f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf29d9f-8e6b-4df5-8871-32b4dfed298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf29d9f-8e6b-4df5-8871-32b4dfed298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-939644042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e30093-b3ed-431c-ad8b-8919cf1b3d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3a8b067dc143d1a800e652b5ef8de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=144220e8-9bba-4320-85bd-99bd4fb84472,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:31Z,use_quota=True,user_id='4921cf41f94d4900b356a98e13c69675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18db27ce-7c70-411a-afca-e3c382c658b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18db27ce-7c70-411a-afca-e3c382c658b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad2cf96-5a85-446b-9fdc-160878077ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad2cf96-5a85-446b-9fdc-160878077ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd1e30093-b3ed-431c-ad8b-8919cf1b3d7f', 'volume_name': 'volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f', 'volume_size': 2, 'snapshot_id': '144220e8-9bba-4320-85bd-99bd4fb84472'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4270647d-a8cd-4ab3-aab6-008f962a0673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4270647d-a8cd-4ab3-aab6-008f962a0673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c178f48-54ae-4b6d-aa2c-ed39b8484737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:31 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Volume d1e30093-b3ed-431c-ad8b-8919cf1b3d7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f', 'volume_size': 2, 'snapshot_id': '144220e8-9bba-4320-85bd-99bd4fb84472'} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:31 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc" returned: 0 in 0.773s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.219s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-144220e8-9bba-4320-85bd-99bd4fb84472-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" by "_create_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5d3bbb-7da4-4f9b-96fe-1e2ede49b4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0276168f-ff72-4888-98df-6a7ef830f1bc', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0822dd47-639f-46fd-8fcb-a5505a87d909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-144220e8-9bba-4320-85bd-99bd4fb84472-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Creating volume d1e30093-b3ed-431c-ad8b-8919cf1b3d7f from snapshot 144220e8-9bba-4320-85bd-99bd4fb84472 {{(pid=87216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:31 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Volume volume-0276168f-ff72-4888-98df-6a7ef830f1bc (0276168f-ff72-4888-98df-6a7ef830f1bc): created successfully Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0822dd47-639f-46fd-8fcb-a5505a87d909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Flow 'volume_create_manager' (8f7b554f-943d-4802-8397-c0c54543c6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] snapshot: 144220e8-9bba-4320-85bd-99bd4fb84472, volume: d1e30093-b3ed-431c-ad8b-8919cf1b3d7f, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:31 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-617b481b-6c50-4655-a7b9-c95d7031798e tempest-VolumesListAdminTestJSON-1063482149 None] Created volume successfully. Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[95706a4f-18f0-49a8-b961-6f69e105469a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:31 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 Jul 09 03:13:31 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:32 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472" returned: 0 in 1.455s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43df1c0-1e5d-42c7-a068-052b6307fc7b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Flow 'volume_create_manager' (42fbec19-904e-43d4-a404-9e83cf9f24de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ffa687-4dd1-4636-ae08-f9705f6fcd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ffa687-4dd1-4636-ae08-f9705f6fcd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8430105b-81c7-4d84-8a6a-ce108077e30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1ea239778648bc8478f83a97543c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:33Z,use_quota=True,user_id='04a42fd5f6a5432280cd63cdcefcf6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff0b0ab-0378-4e61-bc8c-214b81887d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff0b0ab-0378-4e61-bc8c-214b81887d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe3de4b-f626-462e-9537-7077c598b927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe3de4b-f626-462e-9537-7077c598b927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8430105b-81c7-4d84-8a6a-ce108077e30c', 'volume_name': 'volume-8430105b-81c7-4d84-8a6a-ce108077e30c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732f3c7d-fd89-4618-aad0-eec2ffb600a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732f3c7d-fd89-4618-aad0-eec2ffb600a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a051dc-9119-452b-8649-1c7691b096c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:33 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e Jul 09 03:13:33 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:33 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Volume 8430105b-81c7-4d84-8a6a-ce108077e30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8430105b-81c7-4d84-8a6a-ce108077e30c', 'volume_size': 1} Jul 09 03:13:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:34 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" returned: 0 in 1.392s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:34 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:13:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:34 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f Jul 09 03:13:34 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:42 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" returned: 0 in 8.422s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:42 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ace64a-bfad-425d-ae2b-6962b5dfdb05]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:43 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e Jul 09 03:13:43 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:43 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=37,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:13:43 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=25,cinder:INSERT=7,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:13:44 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" returned: 0 in 1.210s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e, size 1024.00 MB, duration 8.42 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:13:44 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Converted 1024.00 MB image at 121.55 MB/s Jul 09 03:13:44 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f is being set with open permissions: ugo+rw Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:44 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f Jul 09 03:13:44 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:44 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" returned: 0 in 0.764s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" released by "_copy_volume_from_snapshot" :: held 13.396s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-144220e8-9bba-4320-85bd-99bd4fb84472-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" released by "_create_volume_from_snapshot" :: held 13.449s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.481s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.520s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8430105b-81c7-4d84-8a6a-ce108077e30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1ea239778648bc8478f83a97543c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:33Z,use_quota=True,user_id='04a42fd5f6a5432280cd63cdcefcf6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Creating volume 8430105b-81c7-4d84-8a6a-ce108077e30c {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:13:44 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:13:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:44 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c 1073741824 Jul 09 03:13:44 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c178f48-54ae-4b6d-aa2c-ed39b8484737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f', 'volume_size': 2, 'snapshot_id': '144220e8-9bba-4320-85bd-99bd4fb84472'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce655ab3-7dc7-4338-ba6e-32c6d35e2660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:45 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Volume volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f (d1e30093-b3ed-431c-ad8b-8919cf1b3d7f): created successfully Jul 09 03:13:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce655ab3-7dc7-4338-ba6e-32c6d35e2660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Flow 'volume_create_manager' (d5b27956-5e29-42bf-a6a6-93849e2e45f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-252cfc3e-c2ca-4d27-af43-fd9a00d1ea30 tempest-VolumesSnapshotTestJSON-1900569846 None] Created volume successfully. Jul 09 03:13:45 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c 1073741824" returned: 0 in 0.912s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:45 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c Jul 09 03:13:45 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a771bb-a650-4833-935e-d7c4592b980f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:46 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f Jul 09 03:13:46 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:46 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c" returned: 0 in 0.706s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a051dc-9119-452b-8649-1c7691b096c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8430105b-81c7-4d84-8a6a-ce108077e30c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646f5319-8072-4de5-9f25-3fc5c08f7724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:46 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Volume volume-8430105b-81c7-4d84-8a6a-ce108077e30c (8430105b-81c7-4d84-8a6a-ce108077e30c): created successfully Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646f5319-8072-4de5-9f25-3fc5c08f7724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Flow 'volume_create_manager' (42fbec19-904e-43d4-a404-9e83cf9f24de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-22825f17-ffd6-4222-a9d3-6289421f780b tempest-VolumesListAdminTestJSON-661795243 None] Created volume successfully. Jul 09 03:13:47 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" returned: 0 in 0.821s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:47 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f Jul 09 03:13:47 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Acquiring lock "cinder-8430105b-81c7-4d84-8a6a-ce108077e30c-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Lock "cinder-8430105b-81c7-4d84-8a6a-ce108077e30c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Acquiring lock "cinder-quobyte-8430105b-81c7-4d84-8a6a-ce108077e30c" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Lock "cinder-quobyte-8430105b-81c7-4d84-8a6a-ce108077e30c" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[676dcd4f-5358-4c73-b784-d7e3fa764cf3]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "cinder-0276168f-ff72-4888-98df-6a7ef830f1bc-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-0276168f-ff72-4888-98df-6a7ef830f1bc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:47 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c Jul 09 03:13:47 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "cinder-quobyte-0276168f-ff72-4888-98df-6a7ef830f1bc" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-quobyte-0276168f-ff72-4888-98df-6a7ef830f1bc" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[739ecbc0-c1b2-4b59-8acb-9750ecada79c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:47 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc Jul 09 03:13:47 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:48 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" returned: 0 in 1.004s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f" released by "delete_volume" :: held 1.885s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Created reservations ['7765ab82-d1e6-4e23-9d7d-5a6f6b507ae5', 'e837eeed-1b0b-4ea1-8503-66333847b5fb', '185a5afb-3c95-43c8-a9bb-30911e86d72b', '5c50a6a5-65c8-493d-a3f7-47932aa54356'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:48 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c" returned: 0 in 1.017s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:48 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:13:48 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:48 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c Jul 09 03:13:48 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-144220e8-9bba-4320-85bd-99bd4fb84472-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-144220e8-9bba-4320-85bd-99bd4fb84472-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-144220e8-9bba-4320-85bd-99bd4fb84472" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-144220e8-9bba-4320-85bd-99bd4fb84472" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Deleting offline snapshot 144220e8-9bba-4320-85bd-99bd4fb84472 of volume ba399f55-8d64-4e0b-99e7-110d2ea9dc2e {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:13:48 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] snapshot_file for this snap is: volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc" returned: 0 in 1.154s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf8c403-572c-48f5-bc3c-d7de15399f20]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:48 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc Jul 09 03:13:48 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:49 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 Jul 09 03:13:49 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:49 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.907s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:13:49 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Deleted volume successfully. Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-09a235e1-ab5f-4a6d-bd91-66e940f29485 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-d1e30093-b3ed-431c-ad8b-8919cf1b3d7f-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:49 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8430105b-81c7-4d84-8a6a-ce108077e30c" returned: 0 in 0.969s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Lock "cinder-quobyte-8430105b-81c7-4d84-8a6a-ce108077e30c" released by "delete_volume" :: held 2.057s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Created reservations ['f813a5c7-5fa7-4605-8455-85292e460445', 'e4e77dbd-9f93-4f38-a499-d394afdd3ed1', '6bf29d65-70cc-4cfd-986b-e197c35814c3', 'a915ddce-be64-4a67-8143-0f8576aebb66'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:49 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:13:49 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:49 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0276168f-ff72-4888-98df-6a7ef830f1bc" returned: 0 in 0.924s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:49 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-quobyte-0276168f-ff72-4888-98df-6a7ef830f1bc" released by "delete_volume" :: held 2.164s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472" returned: 0 in 0.957s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[946888df-39f0-4ced-8b5f-0185be04ecf4]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Created reservations ['3d739145-e8ec-4a44-9693-3757e9d7228c', '74740e10-8f04-4908-b831-30fb14f12a09', '73854d4c-947e-4133-a2e9-1f9a31b18edd', '3e2d64c9-c07e-4c22-acef-6d050f8b9414'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:49 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e Jul 09 03:13:49 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:50 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:13:50 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:50 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.740s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:50 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:13:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Deleted volume successfully. Jul 09 03:13:50 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f40271f2-1493-4542-9675-92ca46906d6a tempest-VolumesListAdminTestJSON-661795243 None] Lock "cinder-8430105b-81c7-4d84-8a6a-ce108077e30c-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:50 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" returned: 0 in 0.974s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:50 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.872s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:50 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:13:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Deleted volume successfully. Jul 09 03:13:50 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 Jul 09 03:13:50 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:50 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-079f56da-e82c-43c0-a352-182a4f19119a tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-0276168f-ff72-4888-98df-6a7ef830f1bc-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "cinder-20284beb-3a61-422b-93d6-3b615464366c-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-20284beb-3a61-422b-93d6-3b615464366c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "cinder-quobyte-20284beb-3a61-422b-93d6-3b615464366c" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-quobyte-20284beb-3a61-422b-93d6-3b615464366c" acquired by "delete_volume" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:51 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7cf316-b2cb-4961-91fc-17ca5ca4aec9]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:51 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c Jul 09 03:13:51 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:51 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472" returned: 0 in 0.922s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:51 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472 Jul 09 03:13:51 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:52 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c" returned: 0 in 1.065s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:52 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c Jul 09 03:13:52 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:52 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e.144220e8-9bba-4320-85bd-99bd4fb84472" returned: 0 in 1.027s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-144220e8-9bba-4320-85bd-99bd4fb84472" released by "_delete_snapshot" :: held 4.032s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" released by "delete_snapshot" :: held 4.087s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:52 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Created reservations ['70f14ab6-6f20-4129-883a-041560697591', 'b4a9fa35-fc8b-4be1-b65e-2280ac2064a0', '50358fb2-6248-4d13-b96a-0299b9db2219', 'b1e429e4-755d-4a56-ae8f-e6bd4eb081cd'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:13:53 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Delete snapshot completed successfully. Jul 09 03:13:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ed44f26e-ed68-40cf-8cad-bb295085fe31 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-144220e8-9bba-4320-85bd-99bd4fb84472-delete_snapshot" released by "delete_snapshot" :: held 4.406s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:53 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-20284beb-3a61-422b-93d6-3b615464366c" returned: 0 in 1.007s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-quobyte-20284beb-3a61-422b-93d6-3b615464366c" released by "delete_volume" :: held 2.134s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:53 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Created reservations ['e4fd8e15-eb3f-42b4-8a87-a14d956ceca0', 'cd655ea1-6ad7-4de0-8dae-379d7b5cb108', '19dcd826-6110-4856-a17a-338e6174fb3d', '57048d52-7cc4-409b-94d1-a300cb55520f'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:13:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:53 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:13:53 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" acquired by "delete_volume" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:54 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.919s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:13:54 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Deleted volume successfully. Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[473be509-329a-4d01-8cc3-4625ccd955f7]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ecc80f5-fcde-4ff8-b9e9-02d4e3074e58 tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-20284beb-3a61-422b-93d6-3b615464366c-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:54 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e Jul 09 03:13:54 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "cinder-e7dda7ab-3499-4b65-ac9e-47c0905302b9-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-e7dda7ab-3499-4b65-ac9e-47c0905302b9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "cinder-quobyte-e7dda7ab-3499-4b65-ac9e-47c0905302b9" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:13:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-quobyte-e7dda7ab-3499-4b65-ac9e-47c0905302b9" acquired by "delete_volume" :: waited 0.045s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:13:55 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[629e80a3-43c0-4189-9fe2-ac1b1a93e53f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:13:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:55 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9 Jul 09 03:13:55 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:55 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" returned: 0 in 1.237s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:55 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e Jul 09 03:13:55 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:56 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9" returned: 0 in 1.242s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:56 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9 Jul 09 03:13:56 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Flow 'volume_create_manager' (95a64b03-2f48-41cc-b85e-aaea8cd61ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9018669d-b39b-4cbf-a87d-af278a3ad807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9018669d-b39b-4cbf-a87d-af278a3ad807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1176941377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813cc9f750884cec8eeaa5371e87d794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:57Z,use_quota=True,user_id='d9c2ba37694f4371be2b9f7d3abea480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13758d31-8d01-4e46-adde-196bc17525d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13758d31-8d01-4e46-adde-196bc17525d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c6485d-3d8d-48c3-957f-5a0cac9ce0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c6485d-3d8d-48c3-957f-5a0cac9ce0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e', 'volume_name': 'volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb9a640-670f-4b1e-b209-be0d11601b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb9a640-670f-4b1e-b209-be0d11601b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28195978-95f8-42d8-9429-64b8eed7597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:56 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Volume 158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e', 'volume_size': 1} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1176941377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813cc9f750884cec8eeaa5371e87d794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:57Z,use_quota=True,user_id='d9c2ba37694f4371be2b9f7d3abea480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Creating volume 158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:13:56 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:56 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e 1073741824 Jul 09 03:13:56 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:56 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" returned: 0 in 1.077s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e" released by "delete_volume" :: held 2.458s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:56 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Created reservations ['1d345d57-c855-4b1e-aaf5-970bd76144eb', '334419d6-9233-4aee-a64a-221f4b3bbb2d', 'e8ccd1b3-ede9-479c-8f34-896ccfcb66a0', '11277344-ad2e-4cd2-b673-7c7b276d068b'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:57 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e7dda7ab-3499-4b65-ac9e-47c0905302b9" returned: 0 in 0.886s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:57 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:13:57 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-quobyte-e7dda7ab-3499-4b65-ac9e-47c0905302b9" released by "delete_volume" :: held 2.218s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Created reservations ['87789c34-bdd3-4ff0-a2c3-4b0fd4ca7c0c', 'fc24fb05-0bfa-4aed-9b30-bf5498a7f465', '6d975808-2d30-4791-9dcf-7e95734211f0', '6879853e-3724-4de4-9a91-fb3180122c53'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:57 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:13:57 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:57 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.883s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:13:58 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Deleted volume successfully. Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9d253e0d-8077-4ab2-8edf-8b4d5bacae09 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-ba399f55-8d64-4e0b-99e7-110d2ea9dc2e-delete_volume" released by "delete_volume" :: held 3.765s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:58 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e 1073741824" returned: 0 in 1.414s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:58 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e Jul 09 03:13:58 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:13:58 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Flow 'volume_create_manager' (0490d588-ed89-409f-b711-2a2499ca851d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32abc800-5296-4602-8160-f524e81f3836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.013s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:13:58 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Deleted volume successfully. Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32abc800-5296-4602-8160-f524e81f3836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1637272309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3a8b067dc143d1a800e652b5ef8de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:58Z,use_quota=True,user_id='4921cf41f94d4900b356a98e13c69675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6762fd-568b-4c45-a856-53606f9a025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6762fd-568b-4c45-a856-53606f9a025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d9f704-0286-4ee4-9818-ef3493361e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d9f704-0286-4ee4-9818-ef3493361e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d', 'volume_name': 'volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0a16dc-9995-4697-b25f-45ea99171e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0a16dc-9995-4697-b25f-45ea99171e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676ad97a-a5c6-4f0a-9d5e-0b4d6332e8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:58 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Volume 4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d', 'volume_size': 1} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5b63f938-06bb-450e-82e0-81cbd355268f tempest-VolumesListAdminTestJSON-1063482149 None] Lock "cinder-e7dda7ab-3499-4b65-ac9e-47c0905302b9-delete_volume" released by "delete_volume" :: held 3.681s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Flow 'volume_create_manager' (7d40df9e-4de3-43b7-ba5d-748e851abb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aeed396-0316-49e2-90e2-177e3d587ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aeed396-0316-49e2-90e2-177e3d587ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2008973541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b2b120-c07a-481f-be12-2191ae783746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319fec530d94f5498419b4d700e8bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:59Z,use_quota=True,user_id='f3f7d611aee14f6fb38dfe55601f5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efad666-527e-4380-9556-7bfbcf35afed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efad666-527e-4380-9556-7bfbcf35afed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1387569-248c-48e0-bd07-7a80f5755fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1387569-248c-48e0-bd07-7a80f5755fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b2b120-c07a-481f-be12-2191ae783746', 'volume_name': 'volume-21b2b120-c07a-481f-be12-2191ae783746', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325fb36d-811d-41b0-a3cf-6a0bf8a0cb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325fb36d-811d-41b0-a3cf-6a0bf8a0cb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23be54b-d68a-4084-a777-dfba5d3a2aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:58 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Volume 21b2b120-c07a-481f-be12-2191ae783746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b2b120-c07a-481f-be12-2191ae783746', 'volume_size': 1} Jul 09 03:13:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:59 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e" returned: 0 in 0.921s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] <== create_volume: return (2387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1637272309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3a8b067dc143d1a800e652b5ef8de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:58Z,use_quota=True,user_id='4921cf41f94d4900b356a98e13c69675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Creating volume 4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:13:59 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:13:59 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d 1073741824 Jul 09 03:13:59 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28195978-95f8-42d8-9429-64b8eed7597e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9cfbbb4-d0a4-42fc-9248-15ba4cac51d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:59 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Volume volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e (158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e): created successfully Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9cfbbb4-d0a4-42fc-9248-15ba4cac51d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Flow 'volume_create_manager' (95a64b03-2f48-41cc-b85e-aaea8cd61ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:59 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4f48c995-80e6-4dde-bcaa-d7ef20e3fc78 tempest-AttachVolumeTestJSON-1708502489 None] Created volume successfully. Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Flow 'volume_create_manager' (c1e18d45-df53-417f-9831-658640215fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1e3dab-c20c-4baa-b522-11c81285a0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1e3dab-c20c-4baa-b522-11c81285a0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1952395679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3697cded-4be2-4602-974a-370ed7a4d083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319fec530d94f5498419b4d700e8bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:59Z,use_quota=True,user_id='f3f7d611aee14f6fb38dfe55601f5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76a5c85-c48d-4446-bb79-32fab96653a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76a5c85-c48d-4446-bb79-32fab96653a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965f3658-9d27-4c34-8cc7-bc2d791caf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965f3658-9d27-4c34-8cc7-bc2d791caf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3697cded-4be2-4602-974a-370ed7a4d083', 'volume_name': 'volume-3697cded-4be2-4602-974a-370ed7a4d083', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189defbd-5ba3-4cac-b1bf-a4551a710cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189defbd-5ba3-4cac-b1bf-a4551a710cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b04c3a-9e29-4f4e-bbea-fd66f9e2e302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:13:59 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Volume 3697cded-4be2-4602-974a-370ed7a4d083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3697cded-4be2-4602-974a-370ed7a4d083', 'volume_size': 1} Jul 09 03:13:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:00 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d 1073741824" returned: 0 in 1.276s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:00 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d Jul 09 03:14:00 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:01 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" returned: 0 in 0.758s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.100s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.255s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2008973541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b2b120-c07a-481f-be12-2191ae783746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319fec530d94f5498419b4d700e8bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:59Z,use_quota=True,user_id='f3f7d611aee14f6fb38dfe55601f5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Creating volume 21b2b120-c07a-481f-be12-2191ae783746 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:14:01 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676ad97a-a5c6-4f0a-9d5e-0b4d6332e8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:01 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746 1073741824 Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ecb94c-aa3f-4dd2-b9d7-0c6c1e5758ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:01 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:01 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Volume volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d (4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d): created successfully Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ecb94c-aa3f-4dd2-b9d7-0c6c1e5758ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Flow 'volume_create_manager' (0490d588-ed89-409f-b711-2a2499ca851d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-84137462-587b-4683-8df5-563c17914f2c tempest-VolumesSnapshotTestJSON-1900569846 None] Created volume successfully. Jul 09 03:14:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:02 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746 1073741824" returned: 0 in 1.174s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:02 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746 Jul 09 03:14:02 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-b416bef7-2202-4bc7-b404-41c40b16289d req-338ba580-dbf4-4c62-b6d3-24cd3adce7f2 tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:03 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746" returned: 0 in 0.859s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.896s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1952395679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3697cded-4be2-4602-974a-370ed7a4d083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319fec530d94f5498419b4d700e8bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:13:59Z,use_quota=True,user_id='f3f7d611aee14f6fb38dfe55601f5276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Creating volume 3697cded-4be2-4602-974a-370ed7a4d083 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:14:03 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:03 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083 1073741824 Jul 09 03:14:03 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23be54b-d68a-4084-a777-dfba5d3a2aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b2b120-c07a-481f-be12-2191ae783746', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b92025-a499-4fbe-8794-47a367e9148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:03 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Volume volume-21b2b120-c07a-481f-be12-2191ae783746 (21b2b120-c07a-481f-be12-2191ae783746): created successfully Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b92025-a499-4fbe-8794-47a367e9148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Flow 'volume_create_manager' (7d40df9e-4de3-43b7-ba5d-748e851abb53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:03 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3dfa5b24-9ff9-40bf-822f-5170b20955fe tempest-TestServerVolumeAttachmentScenario-423475292 None] Created volume successfully. Jul 09 03:14:04 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083 1073741824" returned: 0 in 1.133s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:04 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083 Jul 09 03:14:04 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:05 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083" returned: 0 in 0.731s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:14:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.413s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b04c3a-9e29-4f4e-bbea-fd66f9e2e302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3697cded-4be2-4602-974a-370ed7a4d083', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34930f49-3407-4fc8-97e5-14251adf8026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] Creating offline snapshot 09a6d635-f45a-40de-8e7d-cefc853d0797 of volume 4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:14:05 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Volume volume-3697cded-4be2-4602-974a-370ed7a4d083 (3697cded-4be2-4602-974a-370ed7a4d083): created successfully Jul 09 03:14:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34930f49-3407-4fc8-97e5-14251adf8026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Flow 'volume_create_manager' (c1e18d45-df53-417f-9831-658640215fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:05 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e37091-080e-4ccb-8333-4209d478d824]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:05 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-01f8606f-0ba4-4d9a-85fc-19d620e39d16 tempest-TestServerVolumeAttachmentScenario-423475292 None] Created volume successfully. Jul 09 03:14:05 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d Jul 09 03:14:05 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:06 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" returned: 0 in 0.914s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:06 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 1G Jul 09 03:14:06 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:07 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 1G" returned: 0 in 0.922s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:07 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 Jul 09 03:14:07 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:08 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797" returned: 0 in 0.826s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:08 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 is being set with open permissions: ugo+rw Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:08 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 Jul 09 03:14:08 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Flow 'volume_create_manager' (7f9ead57-1e59-4740-8d87-9764429667db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1680606f-1ceb-455a-9c75-da3729487770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1680606f-1ceb-455a-9c75-da3729487770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-342113426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a39b51f-2440-4d49-8cbe-57c3a6e791c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d84ee082ab4c74bd812b7a8ca47746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:14:08Z,use_quota=True,user_id='cb8997fa7c044b19a271b29e91650221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e787324f-0c85-4baf-861d-22b8df52bac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e787324f-0c85-4baf-861d-22b8df52bac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628142d8-4d9e-4001-a70b-0810779e4d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628142d8-4d9e-4001-a70b-0810779e4d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a39b51f-2440-4d49-8cbe-57c3a6e791c0', 'volume_name': 'volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1ea77f-3a28-4673-b1d2-13a8f2a1a504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1ea77f-3a28-4673-b1d2-13a8f2a1a504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59956c8-0674-4201-90f8-0bbeb4597105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:08 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Volume 4a39b51f-2440-4d49-8cbe-57c3a6e791c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0', 'volume_size': 1} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:08 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797" returned: 0 in 0.771s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:08 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.info Jul 09 03:14:08 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:09 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.info" returned: 0 in 0.795s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:09 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.info is being set with open permissions: ugo+rw Jul 09 03:14:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:09 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.info Jul 09 03:14:09 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:10 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.info" returned: 0 in 0.816s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.170s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-b416bef7-2202-4bc7-b404-41c40b16289d req-338ba580-dbf4-4c62-b6d3-24cd3adce7f2 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.419s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:10 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f79d390-2c7b-446d-86df-5fce32e4722e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-b416bef7-2202-4bc7-b404-41c40b16289d req-338ba580-dbf4-4c62-b6d3-24cd3adce7f2 tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-05a5ff4f-e3b2-4675-b6dc-4ea2c2ff4521 tempest-VolumesSnapshotTestJSON-1900569846 None] Create snapshot completed successfully Jul 09 03:14:10 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e Jul 09 03:14:10 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:11 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-b416bef7-2202-4bc7-b404-41c40b16289d req-338ba580-dbf4-4c62-b6d3-24cd3adce7f2 tempest-AttachVolumeTestJSON-1708502489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e" returned: 0 in 0.820s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-b416bef7-2202-4bc7-b404-41c40b16289d req-338ba580-dbf4-4c62-b6d3-24cd3adce7f2 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.844s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.922s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-342113426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a39b51f-2440-4d49-8cbe-57c3a6e791c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d84ee082ab4c74bd812b7a8ca47746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:14:08Z,use_quota=True,user_id='cb8997fa7c044b19a271b29e91650221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Creating volume 4a39b51f-2440-4d49-8cbe-57c3a6e791c0 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:14:11 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:11 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0 1073741824 Jul 09 03:14:11 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-b416bef7-2202-4bc7-b404-41c40b16289d req-338ba580-dbf4-4c62-b6d3-24cd3adce7f2 tempest-AttachVolumeTestJSON-1708502489 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69c862ec-5de8-4589-8085-24b739a927a0', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:14:11 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-b416bef7-2202-4bc7-b404-41c40b16289d req-338ba580-dbf4-4c62-b6d3-24cd3adce7f2 tempest-AttachVolumeTestJSON-1708502489 None] attachment_update completed successfully. Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Flow 'volume_create_manager' (fb400827-b72f-49c5-9261-700b281d3246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a4e525-146c-4da9-baf1-326ab80ea41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a4e525-146c-4da9-baf1-326ab80ea41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-769325912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5883404a-f991-4d52-a085-6f623062b843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3a8b067dc143d1a800e652b5ef8de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=09a6d635-f45a-40de-8e7d-cefc853d0797,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:14:12Z,use_quota=True,user_id='4921cf41f94d4900b356a98e13c69675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05565b5f-0261-4032-b09d-7717d03c6e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05565b5f-0261-4032-b09d-7717d03c6e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4914483b-2c1a-4fbd-8227-4e9da0a21a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4914483b-2c1a-4fbd-8227-4e9da0a21a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5883404a-f991-4d52-a085-6f623062b843', 'volume_name': 'volume-5883404a-f991-4d52-a085-6f623062b843', 'volume_size': 1, 'snapshot_id': '09a6d635-f45a-40de-8e7d-cefc853d0797'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be2b1a7-ec1b-44ae-a334-e0ea1d89c585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be2b1a7-ec1b-44ae-a334-e0ea1d89c585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c37d7fa-bce9-4078-b369-196743889d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:12 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Volume 5883404a-f991-4d52-a085-6f623062b843: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5883404a-f991-4d52-a085-6f623062b843', 'volume_size': 1, 'snapshot_id': '09a6d635-f45a-40de-8e7d-cefc853d0797'} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:12 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0 1073741824" returned: 0 in 1.065s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:12 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0 Jul 09 03:14:12 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:13 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0" returned: 0 in 0.688s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.773s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-09a6d635-f45a-40de-8e7d-cefc853d0797-5883404a-f991-4d52-a085-6f623062b843" by "_create_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59956c8-0674-4201-90f8-0bbeb4597105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde739c0-01e3-4d4a-9da7-d9f772f54ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-09a6d635-f45a-40de-8e7d-cefc853d0797-5883404a-f991-4d52-a085-6f623062b843" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Creating volume 5883404a-f991-4d52-a085-6f623062b843 from snapshot 09a6d635-f45a-40de-8e7d-cefc853d0797 {{(pid=87216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-5883404a-f991-4d52-a085-6f623062b843" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:13 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Volume volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0 (4a39b51f-2440-4d49-8cbe-57c3a6e791c0): created successfully Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde739c0-01e3-4d4a-9da7-d9f772f54ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Flow 'volume_create_manager' (7f9ead57-1e59-4740-8d87-9764429667db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-5883404a-f991-4d52-a085-6f623062b843" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] snapshot: 09a6d635-f45a-40de-8e7d-cefc853d0797, volume: 5883404a-f991-4d52-a085-6f623062b843, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-e255f50a-0940-492e-8e73-41d512842235 tempest-VolumesTransfersV355Test-1526095172 None] Created volume successfully. Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1fdb2a-be06-4ad4-95fb-84cabccd3f3e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:13 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 Jul 09 03:14:13 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:13 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:14:13 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:14 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797" returned: 0 in 1.198s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:14 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:14:14 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:14:14 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:14:14 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9024dc0b-992f-42c4-b085-59bf9f8d13e0]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:14 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d Jul 09 03:14:14 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:14 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.067s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:14:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:14:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:14:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:14:14 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-729c85e8-8d4a-4e82-a799-0b7567bedf91 tempest-VolumesTransfersV355Test-861163998 None] Transfer volume completed successfully. Jul 09 03:14:15 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" returned: 0 in 0.913s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:15 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843 not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:14:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:15 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843 Jul 09 03:14:15 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Acquiring lock "cinder-4a39b51f-2440-4d49-8cbe-57c3a6e791c0-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Lock "cinder-4a39b51f-2440-4d49-8cbe-57c3a6e791c0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Acquiring lock "cinder-quobyte-4a39b51f-2440-4d49-8cbe-57c3a6e791c0" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Lock "cinder-quobyte-4a39b51f-2440-4d49-8cbe-57c3a6e791c0" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:16 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[97808415-999f-4ddd-a4a7-ded136e754c8]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:16 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0 Jul 09 03:14:16 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:17 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:14:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Flow 'volume_create_manager' (c1ef631c-7ec9-4e20-9121-c1cddda482f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82fc28e2-508b-4695-8509-d3607025673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82fc28e2-508b-4695-8509-d3607025673a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1261777532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d50c062-6cd7-4a78-b593-bfab1ff904ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813cc9f750884cec8eeaa5371e87d794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:14:17Z,use_quota=True,user_id='d9c2ba37694f4371be2b9f7d3abea480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0baa0c-689c-4e82-a488-a0e4a53d76e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0baa0c-689c-4e82-a488-a0e4a53d76e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9784c3e-98e3-4aa7-8eb0-8d5744399f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9784c3e-98e3-4aa7-8eb0-8d5744399f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d50c062-6cd7-4a78-b593-bfab1ff904ae', 'volume_name': 'volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5c0f94-a49d-44bd-be53-9407eddfccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5c0f94-a49d-44bd-be53-9407eddfccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b09aefc8-ddd5-4877-ad0c-9a583febae4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:18 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Volume 9d50c062-6cd7-4a78-b593-bfab1ff904ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae', 'volume_size': 1} Jul 09 03:14:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:18 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0" returned: 0 in 2.091s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:18 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0 Jul 09 03:14:18 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:20 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4a39b51f-2440-4d49-8cbe-57c3a6e791c0" returned: 0 in 2.150s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Lock "cinder-quobyte-4a39b51f-2440-4d49-8cbe-57c3a6e791c0" released by "delete_volume" :: held 4.322s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:20 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Created reservations ['25ed592a-0fb3-4fa7-9790-00e1516e5b17', 'e698c2c7-4752-40a5-8e63-bc27e768b338', 'd5cf53f0-2abb-4724-b8dd-0d8c2a0210e5', '7f0d4c50-0886-455c-af8a-278654853d36'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:14:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:21 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:14:21 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:23 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 2.560s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:23 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:14:23 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Deleted volume successfully. Jul 09 03:14:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f6173ad8-0d39-44b2-8a1f-a8ae17bef7cf tempest-VolumesTransfersV355Test-922861811 None] Lock "cinder-4a39b51f-2440-4d49-8cbe-57c3a6e791c0-delete_volume" released by "delete_volume" :: held 7.651s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Flow 'volume_create_manager' (82491321-45f8-4969-ad4c-c478df5911f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8807d0-4be9-45db-98b6-3a217f9e1858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8807d0-4be9-45db-98b6-3a217f9e1858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-872676427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94815d4d-9387-4d81-b77f-41bc94c4abb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d84ee082ab4c74bd812b7a8ca47746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:14:24Z,use_quota=True,user_id='cb8997fa7c044b19a271b29e91650221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e22a13-4316-48e3-bc29-c5cc34f1e7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e22a13-4316-48e3-bc29-c5cc34f1e7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84398c39-8c88-43fe-8df5-92ed1adf70de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84398c39-8c88-43fe-8df5-92ed1adf70de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94815d4d-9387-4d81-b77f-41bc94c4abb3', 'volume_name': 'volume-94815d4d-9387-4d81-b77f-41bc94c4abb3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362f9370-bee0-4606-8bd9-d009ecd24846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362f9370-bee0-4606-8bd9-d009ecd24846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b18232f-907f-48e6-a68f-5cff526317a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:24 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Volume 94815d4d-9387-4d81-b77f-41bc94c4abb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94815d4d-9387-4d81-b77f-41bc94c4abb3', 'volume_size': 1} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:24 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843" returned: 0 in 8.948s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2293dde-87a3-4d9e-a12e-2be1bc4540c1]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:24 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d Jul 09 03:14:24 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:25 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" returned: 0 in 1.016s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:25 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d, size 1024.00 MB, duration 8.95 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:14:25 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Converted 1024.00 MB image at 114.42 MB/s Jul 09 03:14:25 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843 is being set with open permissions: ugo+rw Jul 09 03:14:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:25 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843 Jul 09 03:14:25 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:26 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843" returned: 0 in 0.663s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-5883404a-f991-4d52-a085-6f623062b843" released by "_copy_volume_from_snapshot" :: held 12.878s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-09a6d635-f45a-40de-8e7d-cefc853d0797-5883404a-f991-4d52-a085-6f623062b843" released by "_create_volume_from_snapshot" :: held 12.925s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.956s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.824s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1261777532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d50c062-6cd7-4a78-b593-bfab1ff904ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813cc9f750884cec8eeaa5371e87d794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:14:17Z,use_quota=True,user_id='d9c2ba37694f4371be2b9f7d3abea480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Creating volume 9d50c062-6cd7-4a78-b593-bfab1ff904ae {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:14:26 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:26 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae 1073741824 Jul 09 03:14:26 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c37d7fa-bce9-4078-b369-196743889d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5883404a-f991-4d52-a085-6f623062b843', 'volume_size': 1, 'snapshot_id': '09a6d635-f45a-40de-8e7d-cefc853d0797'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fcf6b7-5d95-4a93-86db-228a4d5b74ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:26 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Volume volume-5883404a-f991-4d52-a085-6f623062b843 (5883404a-f991-4d52-a085-6f623062b843): created successfully Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fcf6b7-5d95-4a93-86db-228a4d5b74ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Flow 'volume_create_manager' (fb400827-b72f-49c5-9261-700b281d3246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bb2faa88-ae9b-42d4-b36e-1c608637004d tempest-VolumesSnapshotTestJSON-1900569846 None] Created volume successfully. Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-5883404a-f991-4d52-a085-6f623062b843-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-5883404a-f991-4d52-a085-6f623062b843-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-5883404a-f991-4d52-a085-6f623062b843" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-5883404a-f991-4d52-a085-6f623062b843" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ac2d14-a2de-44e7-a9e8-c413975035fc]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:26 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843 Jul 09 03:14:26 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:26 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae 1073741824" returned: 0 in 0.910s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:27 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae Jul 09 03:14:27 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:27 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843" returned: 0 in 0.819s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:27 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843 Jul 09 03:14:27 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:27 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae" returned: 0 in 0.767s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.537s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-872676427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94815d4d-9387-4d81-b77f-41bc94c4abb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d84ee082ab4c74bd812b7a8ca47746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:14:24Z,use_quota=True,user_id='cb8997fa7c044b19a271b29e91650221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Creating volume 94815d4d-9387-4d81-b77f-41bc94c4abb3 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:14:27 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b09aefc8-ddd5-4877-ad0c-9a583febae4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a3ba0a-981f-4732-886f-5f999281a630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:27 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3 1073741824 Jul 09 03:14:27 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:27 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Volume volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae (9d50c062-6cd7-4a78-b593-bfab1ff904ae): created successfully Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a3ba0a-981f-4732-886f-5f999281a630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Flow 'volume_create_manager' (c1ef631c-7ec9-4e20-9121-c1cddda482f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-543f64cf-2bf0-4227-b39c-3babf6b60150 tempest-AttachVolumeTestJSON-1708502489 None] Created volume successfully. Jul 09 03:14:28 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5883404a-f991-4d52-a085-6f623062b843" returned: 0 in 0.701s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-5883404a-f991-4d52-a085-6f623062b843" released by "delete_volume" :: held 1.571s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Created reservations ['5c92ca58-3d9d-4797-8823-247d5cfcf005', '29f4bcff-3a02-4e52-8b47-b3ef5e19d414', '9feed1c3-ed2c-425c-9eae-7bbc08d22424', '1468001d-034d-41c6-aada-f4ce71c3d1d5'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:28 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:14:28 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:28 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3 1073741824" returned: 0 in 0.988s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:28 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3 Jul 09 03:14:28 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-09a6d635-f45a-40de-8e7d-cefc853d0797-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-09a6d635-f45a-40de-8e7d-cefc853d0797-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-09a6d635-f45a-40de-8e7d-cefc853d0797" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-09a6d635-f45a-40de-8e7d-cefc853d0797" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Deleting offline snapshot 09a6d635-f45a-40de-8e7d-cefc853d0797 of volume 4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] snapshot_file for this snap is: volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd95e06-e4d4-4f83-80ce-6cd5032fa054]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:29 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 Jul 09 03:14:29 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:29 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.930s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:14:29 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Deleted volume successfully. Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bca6b781-7581-45d9-96ef-c647b30a14e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-5883404a-f991-4d52-a085-6f623062b843-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:29 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3" returned: 0 in 0.901s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b18232f-907f-48e6-a68f-5cff526317a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94815d4d-9387-4d81-b77f-41bc94c4abb3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b002b1-6279-480c-bc4c-152a82f6a6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:29 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Volume volume-94815d4d-9387-4d81-b77f-41bc94c4abb3 (94815d4d-9387-4d81-b77f-41bc94c4abb3): created successfully Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b002b1-6279-480c-bc4c-152a82f6a6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Flow 'volume_create_manager' (82491321-45f8-4969-ad4c-c478df5911f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:29 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-25947ff4-e561-44cd-b45d-a52d494c9f0a tempest-VolumesTransfersV355Test-1526095172 None] Created volume successfully. Jul 09 03:14:29 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797" returned: 0 in 0.845s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:14:30 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3b9862-ad9c-43b4-bea3-01dba6f8dbeb]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:30 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d Jul 09 03:14:30 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Acquiring lock "cinder-94815d4d-9387-4d81-b77f-41bc94c4abb3-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Lock "cinder-94815d4d-9387-4d81-b77f-41bc94c4abb3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Acquiring lock "cinder-quobyte-94815d4d-9387-4d81-b77f-41bc94c4abb3" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Lock "cinder-quobyte-94815d4d-9387-4d81-b77f-41bc94c4abb3" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:30 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d6e338-ccd9-4d36-8b2d-dc8d93176852]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:30 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3 Jul 09 03:14:30 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:30 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" returned: 0 in 0.831s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:30 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 Jul 09 03:14:30 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:31 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3" returned: 0 in 0.852s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:31 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3 Jul 09 03:14:31 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:31 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797" returned: 0 in 0.828s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:31 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797 Jul 09 03:14:31 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-17d2ba53-bc8d-4d9f-a757-aa882702a6d3 req-1b46ff4c-e402-4266-9e3a-69644e1a3c7c tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-17d2ba53-bc8d-4d9f-a757-aa882702a6d3 req-1b46ff4c-e402-4266-9e3a-69644e1a3c7c tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20b0a5c-c6f7-4b38-bf82-d05b24bf8846]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-17d2ba53-bc8d-4d9f-a757-aa882702a6d3 req-1b46ff4c-e402-4266-9e3a-69644e1a3c7c tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:32 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae Jul 09 03:14:32 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:32 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-94815d4d-9387-4d81-b77f-41bc94c4abb3" returned: 0 in 0.679s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Lock "cinder-quobyte-94815d4d-9387-4d81-b77f-41bc94c4abb3" released by "delete_volume" :: held 1.584s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Created reservations ['2eae926a-eb54-4808-ab2a-944df5cf2e10', 'f069c3ee-1c3c-4b91-ae02-66aead9583e8', '36d9ff20-bcef-4be9-a694-917a2c466d27', '5633f8fe-4bd0-4ae1-9b01-e6e4d6ac3cdb'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:32 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:14:32 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:32 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d.09a6d635-f45a-40de-8e7d-cefc853d0797" returned: 0 in 0.737s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-09a6d635-f45a-40de-8e7d-cefc853d0797" released by "_delete_snapshot" :: held 3.386s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" released by "delete_snapshot" :: held 3.424s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Created reservations ['ef6a055c-2016-41ba-9893-7c977e54af75', 'c57bc542-68da-4f40-a62e-43d177def7e5', '4ff56060-d868-4017-a5e9-8d46fd6f5a49', '88532a0e-5063-494c-a23c-07baf1357367'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:14:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Delete snapshot completed successfully. Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4cdce82f-3ea8-4054-b01e-879a90bdc445 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-09a6d635-f45a-40de-8e7d-cefc853d0797-delete_snapshot" released by "delete_snapshot" :: held 3.616s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:32 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-17d2ba53-bc8d-4d9f-a757-aa882702a6d3 req-1b46ff4c-e402-4266-9e3a-69644e1a3c7c tempest-AttachVolumeTestJSON-1708502489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae" returned: 0 in 0.904s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-17d2ba53-bc8d-4d9f-a757-aa882702a6d3 req-1b46ff4c-e402-4266-9e3a-69644e1a3c7c tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.933s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-17d2ba53-bc8d-4d9f-a757-aa882702a6d3 req-1b46ff4c-e402-4266-9e3a-69644e1a3c7c tempest-AttachVolumeTestJSON-1708502489 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4177c894-f37b-4813-b067-8ae89e555d90', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:14:33 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-17d2ba53-bc8d-4d9f-a757-aa882702a6d3 req-1b46ff4c-e402-4266-9e3a-69644e1a3c7c tempest-AttachVolumeTestJSON-1708502489 None] attachment_update completed successfully. Jul 09 03:14:33 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.767s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:33 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:14:33 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Deleted volume successfully. Jul 09 03:14:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0e3ee82a-787c-4012-aeb8-0ff30ecf3673 tempest-VolumesTransfersV355Test-922861811 None] Lock "cinder-94815d4d-9387-4d81-b77f-41bc94c4abb3-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:33 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a66e48f-9b6d-4eab-96bf-efc81e1582b9]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:33 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d Jul 09 03:14:33 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:34 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" returned: 0 in 0.926s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:34 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d Jul 09 03:14:34 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:35 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" returned: 0 in 0.719s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d" released by "delete_volume" :: held 1.707s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Created reservations ['8690ecfd-5df1-4d03-b6c5-f081bffa2efa', 'ae20b0b7-04d5-4d79-93ae-ddc518bfaa08', 'ded65aa7-3c8d-4077-b1d9-bb57527c1fc0', 'ee8b85d5-3768-4732-8e5d-760cc19635c8'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:35 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:14:35 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-8b112d33-1182-426b-a6af-23dda8b449d4-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-8b112d33-1182-426b-a6af-23dda8b449d4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "cinder-quobyte-8b112d33-1182-426b-a6af-23dda8b449d4" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-8b112d33-1182-426b-a6af-23dda8b449d4" acquired by "delete_volume" :: waited 0.050s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dd011a-f36f-4e67-ad4b-060b1b49b467]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:36 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 Jul 09 03:14:36 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:36 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.967s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:36 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:14:36 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Deleted volume successfully. Jul 09 03:14:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-61a9c5f0-b0f7-446f-89e0-649f3ce5f8e4 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-4e27edb3-4102-4ca5-9d79-5a1b0ac0ba5d-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:37 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4" returned: 0 in 1.125s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:37 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4 Jul 09 03:14:37 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:37 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8b112d33-1182-426b-a6af-23dda8b449d4" returned: 0 in 0.878s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-quobyte-8b112d33-1182-426b-a6af-23dda8b449d4" released by "delete_volume" :: held 2.115s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:37 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Created reservations ['f35f89ed-9c20-4329-8601-6d042b5eb999', '28da99f5-1931-4b38-a01e-9349be3a7475', 'b81e38ae-70d6-44c5-a380-d5f54712b762', '60df2d26-0ca7-49b4-88ec-fa070b89df16'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:14:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:38 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:14:38 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:38 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.721s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:38 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:14:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Deleted volume successfully. Jul 09 03:14:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4354858f-f0e9-49be-9f6a-bb0a156e4e47 tempest-VolumesSnapshotTestJSON-1900569846 None] Lock "cinder-8b112d33-1182-426b-a6af-23dda8b449d4-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:39 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-8b677e13-70ac-4e44-b5b8-025b0f327e31 req-d757baeb-4ba2-4bd0-a605-96626a3d875d tempest-AttachVolumeTestJSON-1708502489 None] Terminate volume connection completed successfully. Jul 09 03:14:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-8b677e13-70ac-4e44-b5b8-025b0f327e31 req-d757baeb-4ba2-4bd0-a605-96626a3d875d tempest-AttachVolumeTestJSON-1708502489 None] Deleting attachment 69c862ec-5de8-4589-8085-24b739a927a0. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Flow 'volume_create_manager' (8e639db9-36e1-42b6-815b-66cbae933839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec27c04c-d4af-4420-804c-e235ffbb9908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec27c04c-d4af-4420-804c-e235ffbb9908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-541810878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae23ac26-34db-4e94-aaae-e063f750c11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc4f34093c74b4abb9a70b79e1105ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:14:41Z,use_quota=True,user_id='a50492ac5cba497c92a57bd6d91e2bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8e8404-bd3e-416d-b655-baab79350202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8e8404-bd3e-416d-b655-baab79350202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f36eb0-05f1-4b79-b016-2432e6eb7d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f36eb0-05f1-4b79-b016-2432e6eb7d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae23ac26-34db-4e94-aaae-e063f750c11b', 'volume_name': 'volume-ae23ac26-34db-4e94-aaae-e063f750c11b', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b8f70a-3628-4321-9e70-329b724bb56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b8f70a-3628-4321-9e70-329b724bb56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fff28f-dd60-42ce-82be-77744e26e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:41 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Volume ae23ac26-34db-4e94-aaae-e063f750c11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae23ac26-34db-4e94-aaae-e063f750c11b', 'volume_size': 1} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-541810878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae23ac26-34db-4e94-aaae-e063f750c11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc4f34093c74b4abb9a70b79e1105ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:14:41Z,use_quota=True,user_id='a50492ac5cba497c92a57bd6d91e2bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Creating volume ae23ac26-34db-4e94-aaae-e063f750c11b {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:14:41 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:41 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b 1073741824 Jul 09 03:14:41 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:41 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-4861c2b3-4ac4-4a7a-8f84-4f21f6cde3e7 req-13918bb5-f486-4764-8af1-c23ea89eb016 tempest-AttachVolumeTestJSON-1708502489 None] Terminate volume connection completed successfully. Jul 09 03:14:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4861c2b3-4ac4-4a7a-8f84-4f21f6cde3e7 req-13918bb5-f486-4764-8af1-c23ea89eb016 tempest-AttachVolumeTestJSON-1708502489 None] Deleting attachment 4177c894-f37b-4813-b067-8ae89e555d90. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:14:42 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b 1073741824" returned: 0 in 1.076s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:42 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b Jul 09 03:14:42 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:43 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b" returned: 0 in 0.745s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:14:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:43 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=106,cinder:UPDATE=129,cinder:DELETE=11,cinder:INSERT=32 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:14:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fff28f-dd60-42ce-82be-77744e26e393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae23ac26-34db-4e94-aaae-e063f750c11b', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b5561f-a09c-414f-8535-bd932cd18a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:43 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=137,cinder:SELECT=100,cinder:INSERT=30,cinder:DELETE=11 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:14:43 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Volume volume-ae23ac26-34db-4e94-aaae-e063f750c11b (ae23ac26-34db-4e94-aaae-e063f750c11b): created successfully Jul 09 03:14:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b5561f-a09c-414f-8535-bd932cd18a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Flow 'volume_create_manager' (8e639db9-36e1-42b6-815b-66cbae933839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d55bb76b-1cac-4cf4-bbe3-1ae84e0549d0 tempest-VolumesTransfersV357Test-124642072 None] Created volume successfully. Jul 09 03:14:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d5852160-ae51-4f11-981a-018a81920c30 tempest-VolumesTransfersV357Test-925901751 None] Transfer volume completed successfully. Jul 09 03:14:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Acquiring lock "cinder-ae23ac26-34db-4e94-aaae-e063f750c11b-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Lock "cinder-ae23ac26-34db-4e94-aaae-e063f750c11b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Acquiring lock "cinder-quobyte-ae23ac26-34db-4e94-aaae-e063f750c11b" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Lock "cinder-quobyte-ae23ac26-34db-4e94-aaae-e063f750c11b" acquired by "delete_volume" :: waited 0.033s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:47 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4f9f32-ec57-4533-9efa-bbc04c7167bc]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:47 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b Jul 09 03:14:47 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-b8b2fe80-b59a-4e84-bc8d-8dfe323ccbd8 req-0d38439b-e3de-4539-a5f7-6991acbeaf8f tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-b8b2fe80-b59a-4e84-bc8d-8dfe323ccbd8 req-0d38439b-e3de-4539-a5f7-6991acbeaf8f tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:47 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4754ba32-f06f-49b5-88e7-79ab545fcb28]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-b8b2fe80-b59a-4e84-bc8d-8dfe323ccbd8 req-0d38439b-e3de-4539-a5f7-6991acbeaf8f tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:47 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746 Jul 09 03:14:47 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:48 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b" returned: 0 in 1.083s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:48 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b Jul 09 03:14:48 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:48 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-b8b2fe80-b59a-4e84-bc8d-8dfe323ccbd8 req-0d38439b-e3de-4539-a5f7-6991acbeaf8f tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746" returned: 0 in 0.988s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-b8b2fe80-b59a-4e84-bc8d-8dfe323ccbd8 req-0d38439b-e3de-4539-a5f7-6991acbeaf8f tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.018s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-b8b2fe80-b59a-4e84-bc8d-8dfe323ccbd8 req-0d38439b-e3de-4539-a5f7-6991acbeaf8f tempest-TestServerVolumeAttachmentScenario-423475292 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-21b2b120-c07a-481f-be12-2191ae783746', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28641d63-2916-488d-b678-7f22ef979a51', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:14:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-b8b2fe80-b59a-4e84-bc8d-8dfe323ccbd8 req-0d38439b-e3de-4539-a5f7-6991acbeaf8f tempest-TestServerVolumeAttachmentScenario-423475292 None] attachment_update completed successfully. Jul 09 03:14:49 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae23ac26-34db-4e94-aaae-e063f750c11b" returned: 0 in 0.796s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Lock "cinder-quobyte-ae23ac26-34db-4e94-aaae-e063f750c11b" released by "delete_volume" :: held 1.958s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:49 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Created reservations ['287f0b48-7b4f-43a5-868f-d3d906bc5ae2', 'e158c340-863d-4d7a-9802-cc1ca283308b', '90c19caf-dfe9-4310-82cb-1e931335fe78', 'a4e7bda7-2d46-42e6-95b4-3572f8a05654'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:14:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:49 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:14:49 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:14:50 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Flow 'volume_create_manager' (01978b60-71d3-4d60-a7e2-bf3541ad457c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cf77c4-7339-4f6f-b613-0e81b29dc3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.885s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cf77c4-7339-4f6f-b613-0e81b29dc3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1371509088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574e7b69-b88a-49be-af5e-bec0155d7fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc4f34093c74b4abb9a70b79e1105ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:14:50Z,use_quota=True,user_id='a50492ac5cba497c92a57bd6d91e2bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b35f2a-a6f0-4f56-a637-1dbd9182461c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b35f2a-a6f0-4f56-a637-1dbd9182461c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9095c039-32a1-406f-a3aa-81644e644830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9095c039-32a1-406f-a3aa-81644e644830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574e7b69-b88a-49be-af5e-bec0155d7fd1', 'volume_name': 'volume-574e7b69-b88a-49be-af5e-bec0155d7fd1', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adec2d08-c3fd-4c14-94dd-0a08597f04a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adec2d08-c3fd-4c14-94dd-0a08597f04a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cac60c2-3d0e-49e2-ba63-1e8cb21044d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:50 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Volume 574e7b69-b88a-49be-af5e-bec0155d7fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574e7b69-b88a-49be-af5e-bec0155d7fd1', 'volume_size': 1} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1371509088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574e7b69-b88a-49be-af5e-bec0155d7fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc4f34093c74b4abb9a70b79e1105ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:14:50Z,use_quota=True,user_id='a50492ac5cba497c92a57bd6d91e2bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Creating volume 574e7b69-b88a-49be-af5e-bec0155d7fd1 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:14:50 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Deleted volume successfully. Jul 09 03:14:50 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1 1073741824 Jul 09 03:14:50 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:50 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-84aa318a-abc3-44b4-9d12-a83f34e351b1 tempest-VolumesTransfersV357Test-204250265 None] Lock "cinder-ae23ac26-34db-4e94-aaae-e063f750c11b-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:51 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1 1073741824" returned: 0 in 0.932s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:51 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1 Jul 09 03:14:51 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:52 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1" returned: 0 in 0.965s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:14:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cac60c2-3d0e-49e2-ba63-1e8cb21044d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574e7b69-b88a-49be-af5e-bec0155d7fd1', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fd1e33-45c7-4127-a1e5-16c66a308c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:14:52 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Volume volume-574e7b69-b88a-49be-af5e-bec0155d7fd1 (574e7b69-b88a-49be-af5e-bec0155d7fd1): created successfully Jul 09 03:14:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fd1e33-45c7-4127-a1e5-16c66a308c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:14:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Flow 'volume_create_manager' (01978b60-71d3-4d60-a7e2-bf3541ad457c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:14:52 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bea68334-f948-43d6-9173-ee64fa0a0b31 tempest-VolumesTransfersV357Test-124642072 None] Created volume successfully. Jul 09 03:14:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Acquiring lock "cinder-574e7b69-b88a-49be-af5e-bec0155d7fd1-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Lock "cinder-574e7b69-b88a-49be-af5e-bec0155d7fd1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "cinder-9d50c062-6cd7-4a78-b593-bfab1ff904ae-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Acquiring lock "cinder-quobyte-574e7b69-b88a-49be-af5e-bec0155d7fd1" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-9d50c062-6cd7-4a78-b593-bfab1ff904ae-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Lock "cinder-quobyte-574e7b69-b88a-49be-af5e-bec0155d7fd1" acquired by "delete_volume" :: waited 0.059s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b03a467-40c4-4c48-bd49-259675a50828]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "cinder-quobyte-9d50c062-6cd7-4a78-b593-bfab1ff904ae" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-quobyte-9d50c062-6cd7-4a78-b593-bfab1ff904ae" acquired by "delete_volume" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:54 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0999312f-0bef-4f2c-8b2e-2e2d16acfae7]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:54 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1 Jul 09 03:14:54 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:54 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae Jul 09 03:14:54 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:55 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae" returned: 0 in 1.303s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:55 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1" returned: 0 in 1.444s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:55 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae Jul 09 03:14:55 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:55 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1 Jul 09 03:14:55 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:56 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:56 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-574e7b69-b88a-49be-af5e-bec0155d7fd1" returned: 0 in 1.081s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9d50c062-6cd7-4a78-b593-bfab1ff904ae" returned: 0 in 1.134s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Lock "cinder-quobyte-574e7b69-b88a-49be-af5e-bec0155d7fd1" released by "delete_volume" :: held 2.604s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-quobyte-9d50c062-6cd7-4a78-b593-bfab1ff904ae" released by "delete_volume" :: held 2.522s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Created reservations ['72013d04-c7ed-4326-a8c2-3227de666152', 'f29faf9f-c072-4df3-a0ff-a5932148ecb9', '572e0df8-fb45-4921-a8ee-6ecacc4e66eb', '236ece3a-c849-4040-ba68-fb11a492de04'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Created reservations ['c7c4d6db-99af-4fd6-b241-d17c70fcd5e0', '58fbea60-dff2-47bd-a241-09301f232ae8', '665574dd-f84b-412f-a224-f13849e96763', '6c80690e-4371-47ef-81e1-409db00024fa'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:56 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:14:56 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:56 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:14:56 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "cinder-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "cinder-quobyte-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:14:57 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.002s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:14:57 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Deleted volume successfully. Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-quobyte-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e" acquired by "delete_volume" :: waited 0.089s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-97b65bef-db0f-45ef-a1b3-0f09f35525f0 tempest-VolumesTransfersV357Test-204250265 None] Lock "cinder-574e7b69-b88a-49be-af5e-bec0155d7fd1-delete_volume" released by "delete_volume" :: held 4.131s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:57 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.053s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e54a81-7eee-4546-97b6-a1844689c5b9]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:57 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Deleted volume successfully. Jul 09 03:14:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-000d2501-5e67-483a-aba1-6d06f45cd16f tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-9d50c062-6cd7-4a78-b593-bfab1ff904ae-delete_volume" released by "delete_volume" :: held 4.089s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:58 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e Jul 09 03:14:58 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:58 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e" returned: 0 in 1.049s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:59 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e Jul 09 03:14:59 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:14:59 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 09 03:14:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e" returned: 0 in 0.741s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:14:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-quobyte-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e" released by "delete_volume" :: held 1.869s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:14:59 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Created reservations ['8206db58-1611-4ec0-8c9f-1f0229d727e0', '83f9c473-4c12-4d07-bfaa-ba0e43b6a2ca', '833fe004-33e2-4f9c-977d-e438de858193', '87f3e190-7081-43ea-8b90-266e85fb7ac4'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:14:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:14:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:14:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:14:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:14:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:14:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:14:59 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:14:59 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "cinder-74ae7c3d-b25f-49c2-965e-b85102bca368-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-74ae7c3d-b25f-49c2-965e-b85102bca368-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "cinder-quobyte-74ae7c3d-b25f-49c2-965e-b85102bca368" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-quobyte-74ae7c3d-b25f-49c2-965e-b85102bca368" acquired by "delete_volume" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:00 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9922e6-492f-42ee-b2b2-e1520d446fab]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:00 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368 Jul 09 03:15:00 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:00 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.033s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:00 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:15:00 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Deleted volume successfully. Jul 09 03:15:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4b859be3-e243-46dc-9a9d-da2906c0f039 tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-158ffddb-a160-4ae7-9ba3-3a66ecd6ce1e-delete_volume" released by "delete_volume" :: held 3.353s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-16b275f7-c10a-4afe-9738-454c71b46444 req-3ce96e72-6790-445d-864c-f6abdec04f62 tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-16b275f7-c10a-4afe-9738-454c71b46444 req-3ce96e72-6790-445d-864c-f6abdec04f62 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:01 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:01 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ca0eab-350b-4143-a57c-fc7b1b149f5a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-16b275f7-c10a-4afe-9738-454c71b46444 req-3ce96e72-6790-445d-864c-f6abdec04f62 tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368" returned: 0 in 1.189s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:01 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368 Jul 09 03:15:01 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:01 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083 Jul 09 03:15:01 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:02 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-74ae7c3d-b25f-49c2-965e-b85102bca368" returned: 0 in 0.835s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-quobyte-74ae7c3d-b25f-49c2-965e-b85102bca368" released by "delete_volume" :: held 2.094s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Created reservations ['8dd57d54-c46c-4a0b-a51f-c7e834d1ba9d', '9413588a-fba6-4cfa-b313-d9bd713461fe', '94bd1eda-79f9-4eb9-b79a-7f685fd9fae6', '993b518e-7bca-4b4c-91ee-9df80dda1358'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:15:02 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-16b275f7-c10a-4afe-9738-454c71b46444 req-3ce96e72-6790-445d-864c-f6abdec04f62 tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083" returned: 0 in 1.002s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-16b275f7-c10a-4afe-9738-454c71b46444 req-3ce96e72-6790-445d-864c-f6abdec04f62 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.026s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-16b275f7-c10a-4afe-9738-454c71b46444 req-3ce96e72-6790-445d-864c-f6abdec04f62 tempest-TestServerVolumeAttachmentScenario-423475292 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-3697cded-4be2-4602-974a-370ed7a4d083', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8e367d2-c6a2-4322-8093-eadc757d2dd3', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:02 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:15:02 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:02 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-16b275f7-c10a-4afe-9738-454c71b46444 req-3ce96e72-6790-445d-864c-f6abdec04f62 tempest-TestServerVolumeAttachmentScenario-423475292 None] attachment_update completed successfully. Jul 09 03:15:03 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.926s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:03 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:15:03 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Deleted volume successfully. Jul 09 03:15:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-49151761-fb68-412a-bd04-570cdb3f82dc tempest-AttachVolumeTestJSON-1708502489 None] Lock "cinder-74ae7c3d-b25f-49c2-965e-b85102bca368-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Flow 'volume_create_manager' (816d5428-f3b6-4dad-a616-0852374fb5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f277cf-6eee-4c3e-98cf-3d09c70e7075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f277cf-6eee-4c3e-98cf-3d09c70e7075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1426620591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20e2500-8f8d-4d78-b7c1-9a575020ee5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8664567eb84f139d9604e55d0741c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:06Z,use_quota=True,user_id='d4f73b06e1ad4032ab339ad989bdf386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f631e73a-817b-4d41-8aae-11dd1fbc8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f631e73a-817b-4d41-8aae-11dd1fbc8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c646919f-9ff5-44cd-a148-a15c0387ddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c646919f-9ff5-44cd-a148-a15c0387ddf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c20e2500-8f8d-4d78-b7c1-9a575020ee5d', 'volume_name': 'volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df785857-6b8c-4b0b-a9ec-8811e2c7dccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df785857-6b8c-4b0b-a9ec-8811e2c7dccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a69d3f8-786d-4fbf-8d04-dcaff6a5851d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:05 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Volume c20e2500-8f8d-4d78-b7c1-9a575020ee5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d', 'volume_size': 1} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1426620591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20e2500-8f8d-4d78-b7c1-9a575020ee5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8664567eb84f139d9604e55d0741c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:06Z,use_quota=True,user_id='d4f73b06e1ad4032ab339ad989bdf386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Creating volume c20e2500-8f8d-4d78-b7c1-9a575020ee5d {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:15:05 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:15:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:05 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d 1073741824 Jul 09 03:15:05 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:06 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d 1073741824" returned: 0 in 1.235s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:07 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d Jul 09 03:15:07 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:07 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d" returned: 0 in 0.828s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] <== create_volume: return (2137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:15:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a69d3f8-786d-4fbf-8d04-dcaff6a5851d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffca19c1-263a-4a19-9cab-374d9757975e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:07 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Volume volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d (c20e2500-8f8d-4d78-b7c1-9a575020ee5d): created successfully Jul 09 03:15:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffca19c1-263a-4a19-9cab-374d9757975e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Flow 'volume_create_manager' (816d5428-f3b6-4dad-a616-0852374fb5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:07 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-48e45bd9-39d6-42b7-9e6d-da8780d6ad78 tempest-VolumesCloneTest-1100222651 None] Created volume successfully. Jul 09 03:15:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-771cf0ac-d904-47ed-960d-bbc605a783c7 req-8889b24f-52bb-4ec5-beec-4b273bc3a933 tempest-TestServerVolumeAttachmentScenario-423475292 None] Terminate volume connection completed successfully. Jul 09 03:15:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-771cf0ac-d904-47ed-960d-bbc605a783c7 req-8889b24f-52bb-4ec5-beec-4b273bc3a933 tempest-TestServerVolumeAttachmentScenario-423475292 None] Deleting attachment b8e367d2-c6a2-4322-8093-eadc757d2dd3. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Flow 'volume_create_manager' (496495ee-706d-4bf3-bf03-d82e5cd48ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa6a59d-f005-4428-89c2-fdc09ef6d9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa6a59d-f005-4428-89c2-fdc09ef6d9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1706442284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c843c102-33c7-42c7-a912-4f263bc68f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8664567eb84f139d9604e55d0741c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c20e2500-8f8d-4d78-b7c1-9a575020ee5d,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:09Z,use_quota=True,user_id='d4f73b06e1ad4032ab339ad989bdf386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be725b40-2717-4498-8c31-c4405ecf8bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be725b40-2717-4498-8c31-c4405ecf8bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1998597-553c-49b4-ab19-50f1e66bbd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1998597-553c-49b4-ab19-50f1e66bbd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c843c102-33c7-42c7-a912-4f263bc68f74', 'volume_name': 'volume-c843c102-33c7-42c7-a912-4f263bc68f74', 'volume_size': 2, 'source_volid': 'c20e2500-8f8d-4d78-b7c1-9a575020ee5d', 'source_volstatus': 'available'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740ecb2d-7c35-4cfc-970b-eedff8c78d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740ecb2d-7c35-4cfc-970b-eedff8c78d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491b542e-5e03-4c22-b938-7b53c3d17e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:09 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Volume c843c102-33c7-42c7-a912-4f263bc68f74: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c843c102-33c7-42c7-a912-4f263bc68f74', 'volume_size': 2, 'source_volid': 'c20e2500-8f8d-4d78-b7c1-9a575020ee5d', 'source_volstatus': 'available'} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:09 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Cloning volume c20e2500-8f8d-4d78-b7c1-9a575020ee5d to volume c843c102-33c7-42c7-a912-4f263bc68f74 Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Creating offline snapshot fb13c387-ac24-4ce3-8cb0-c5bccb079e92 of volume c20e2500-8f8d-4d78-b7c1-9a575020ee5d {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[414ccf5e-9c74-4afa-9d0b-bdd27ef82ebe]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:09 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d Jul 09 03:15:09 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:10 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d" returned: 0 in 1.096s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:10 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 1G Jul 09 03:15:10 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:11 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 1G" returned: 0 in 1.068s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:11 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 Jul 09 03:15:11 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:12 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-c3f8f332-c4db-46bd-bf36-a1d946b7a0b9 req-9667761c-7791-4556-8ca1-d4d16f55d68c tempest-TestServerVolumeAttachmentScenario-423475292 None] Terminate volume connection completed successfully. Jul 09 03:15:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-c3f8f332-c4db-46bd-bf36-a1d946b7a0b9 req-9667761c-7791-4556-8ca1-d4d16f55d68c tempest-TestServerVolumeAttachmentScenario-423475292 None] Deleting attachment 28641d63-2916-488d-b678-7f22ef979a51. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:15:12 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92" returned: 0 in 0.874s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:12 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 is being set with open permissions: ugo+rw Jul 09 03:15:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:12 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 Jul 09 03:15:12 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:13 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92" returned: 0 in 0.764s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:13 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.info Jul 09 03:15:13 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:15:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:13 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:15:13 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:14 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.info" returned: 0 in 0.783s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:14 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.info is being set with open permissions: ugo+rw Jul 09 03:15:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:14 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.info Jul 09 03:15:14 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:14 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.054s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:15:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:15:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:15:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:15:14 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Flow 'volume_create_manager' (04584474-ed9f-40f5-8b67-57369f47a4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df023eec-82b8-4368-9802-4202f22b6410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df023eec-82b8-4368-9802-4202f22b6410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1231759512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becdd0b2-a1ba-4761-848b-6bb04f22e81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386d0d7584764f55aa7750f5febe5996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:15Z,use_quota=True,user_id='e465f3ccd689403e935946385d50afc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de92b16a-8178-4858-b651-90611724671f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de92b16a-8178-4858-b651-90611724671f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3507acf-c657-4729-8129-7bafe59d8127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.image.glance [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Creating Keystone auth plugin from conf {{(pid=87216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:15:15 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.info" returned: 0 in 1.038s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Acquiring lock "cinder-quobyte-c843c102-33c7-42c7-a912-4f263bc68f74" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Lock "cinder-quobyte-c843c102-33c7-42c7-a912-4f263bc68f74" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] snapshot: fb13c387-ac24-4ce3-8cb0-c5bccb079e92, volume: c843c102-33c7-42c7-a912-4f263bc68f74, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3507acf-c657-4729-8129-7bafe59d8127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'becdd0b2-a1ba-4761-848b-6bb04f22e81e', 'volume_name': 'volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28dff6e-b2c8-4fea-a0a1-608f8b1a4a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28dff6e-b2c8-4fea-a0a1-608f8b1a4a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2454277c-c52a-42ec-b512-d22991e43192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:15 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Volume becdd0b2-a1ba-4761-848b-6bb04f22e81e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Trying to clone becdd0b2-a1ba-4761-848b-6bb04f22e81e from image ea6ec930-eba2-423b-9437-18da29841701 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]). {{(pid=87216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7661f8e2-aaa2-4789-b8be-e3ab98e57c6a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:15 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 Jul 09 03:15:15 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:16 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:15:16 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Image download 20.69 MB at 20.69 MB/s Jul 09 03:15:16 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e583229-dade-425e-a249-aa7c25d301d4]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:16 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD Jul 09 03:15:16 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:16 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92" returned: 0 in 0.990s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:15:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:15:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:15:16 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b33d511-727e-436d-aa81-9585cfd165a8]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:16 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d Jul 09 03:15:16 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:16 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:16 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Temporary image ea6ec930-eba2-423b-9437-18da29841701 is fetched for user e465f3ccd689403e935946385d50afc0. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:15:17 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9112c174-3a68-458a-b9a0-0bf9f799f556]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:17 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD Jul 09 03:15:17 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:17 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d" returned: 0 in 1.350s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:17 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74 not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:15:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:18 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74 Jul 09 03:15:18 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:18 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD" returned: 0 in 1.083s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-10a51054-5012-4220-8578-2cb485b476da tempest-GroupSnapshotsTest-1781209243 None] Group tempest-GroupSnapshotsTest-Group-1209348151: creating Jul 09 03:15:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-10a51054-5012-4220-8578-2cb485b476da tempest-GroupSnapshotsTest-1781209243 None] Group tempest-GroupSnapshotsTest-Group-1209348151: created successfully Jul 09 03:15:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-10a51054-5012-4220-8578-2cb485b476da tempest-GroupSnapshotsTest-1781209243 None] Create group completed successfully. Jul 09 03:15:23 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74" returned: 0 in 5.629s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:23 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[640771ac-e97b-4067-b010-92cf1fd409c3]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:23 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d Jul 09 03:15:23 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Flow 'volume_create_manager' (d4c17581-70ca-4cd1-8002-1b52d0bfcf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55dd7b43-ce1e-408a-9ee6-6eb21e165ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55dd7b43-ce1e-408a-9ee6-6eb21e165ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-639591341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87110842-c5c6-4c10-8b76-e987cd982625,host='devstack@QuobyteHD#QuobyteHD',id=49371f74-5889-469b-966f-f4d349a2a3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fd88f03773467f99310071f046f629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:24Z,use_quota=True,user_id='58b9c720b6774c62803d1a8e696f8776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50ee0305-4927-4946-abca-04c694b0a80f),volume_type_id=50ee0305-4927-4946-abca-04c694b0a80f)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affd6dff-11b0-4ba6-9f63-01322d2e0bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affd6dff-11b0-4ba6-9f63-01322d2e0bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b420de-040d-4de1-be39-72e6d09790af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b420de-040d-4de1-be39-72e6d09790af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49371f74-5889-469b-966f-f4d349a2a3c7', 'volume_name': 'volume-49371f74-5889-469b-966f-f4d349a2a3c7', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139ef9e7-a29f-4b98-9b94-76915b2e9ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139ef9e7-a29f-4b98-9b94-76915b2e9ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dba1f3-839d-45b1-a134-48db4b814ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:24 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Volume 49371f74-5889-469b-966f-f4d349a2a3c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49371f74-5889-469b-966f-f4d349a2a3c7', 'volume_size': 1} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "cinder-3697cded-4be2-4602-974a-370ed7a4d083-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "cinder-3697cded-4be2-4602-974a-370ed7a4d083-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "cinder-quobyte-3697cded-4be2-4602-974a-370ed7a4d083" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:24 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d" returned: 0 in 1.124s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:15:24 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Converted 1024.00 MB image at 181.87 MB/s Jul 09 03:15:24 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74 is being set with open permissions: ugo+rw Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "cinder-quobyte-3697cded-4be2-4602-974a-370ed7a4d083" acquired by "delete_volume" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:24 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74 Jul 09 03:15:24 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dc2284-2b24-47b3-97c0-54c7ae5569cf]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:24 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083 Jul 09 03:15:24 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:25 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74" returned: 0 in 0.685s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Lock "cinder-quobyte-c843c102-33c7-42c7-a912-4f263bc68f74" released by "_copy_volume_from_snapshot" :: held 9.910s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Acquiring lock "cinder-quobyte-fb13c387-ac24-4ce3-8cb0-c5bccb079e92" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Lock "cinder-quobyte-fb13c387-ac24-4ce3-8cb0-c5bccb079e92" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Deleting offline snapshot fb13c387-ac24-4ce3-8cb0-c5bccb079e92 of volume c20e2500-8f8d-4d78-b7c1-9a575020ee5d {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:15:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] snapshot_file for this snap is: volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:15:25 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[362ad17a-5ec1-455a-a577-9884380992c6]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:25 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083" returned: 0 in 0.787s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:25 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083 Jul 09 03:15:25 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:25 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 Jul 09 03:15:25 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:26 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92" returned: 0 in 0.751s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:15:26 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3697cded-4be2-4602-974a-370ed7a4d083" returned: 0 in 0.708s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de58279d-6319-4526-8e65-3e22e9d8fa7f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "cinder-quobyte-3697cded-4be2-4602-974a-370ed7a4d083" released by "delete_volume" :: held 1.554s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Created reservations ['d28c90be-8e15-48f0-a6d7-82aa35f93a9c', '77ea6446-0f02-44f4-9b35-1614a4da73ed', '7bf026ad-8c18-4bd4-b21d-e0acec2cfb9c', '459ce4b6-f696-4037-888d-9d0c153ff2ed'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:15:26 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d Jul 09 03:15:26 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:26 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:15:26 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "cinder-21b2b120-c07a-481f-be12-2191ae783746-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "cinder-21b2b120-c07a-481f-be12-2191ae783746-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "cinder-quobyte-21b2b120-c07a-481f-be12-2191ae783746" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "cinder-quobyte-21b2b120-c07a-481f-be12-2191ae783746" acquired by "delete_volume" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fe7b3e-7531-4d84-8244-75bbbb716a06]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:27 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746 Jul 09 03:15:27 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:27 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d" returned: 0 in 0.837s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:27 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.717s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:27 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:15:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Deleted volume successfully. Jul 09 03:15:27 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 Jul 09 03:15:27 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2da46f73-6a4b-4534-8bc6-ac1b1ca97510 tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "cinder-3697cded-4be2-4602-974a-370ed7a4d083-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:27 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746" returned: 0 in 0.848s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:27 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746 Jul 09 03:15:27 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:27 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92" returned: 0 in 0.786s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:27 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92 Jul 09 03:15:27 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:28 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-21b2b120-c07a-481f-be12-2191ae783746" returned: 0 in 0.646s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "cinder-quobyte-21b2b120-c07a-481f-be12-2191ae783746" released by "delete_volume" :: held 1.544s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Created reservations ['03e0e0dc-0e37-4ab2-99fc-3d5e19e9cd05', '0be4ff2c-077a-4b73-a944-3322446336cb', '03fbd9e7-5e76-423e-9659-4ef5264127e7', '06eb22da-e670-4357-b960-cc5815a646e8'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:15:28 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d.fb13c387-ac24-4ce3-8cb0-c5bccb079e92" returned: 0 in 0.702s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:28 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:15:28 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Lock "cinder-quobyte-fb13c387-ac24-4ce3-8cb0-c5bccb079e92" released by "_delete_snapshot" :: held 3.184s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.965s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.429s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1231759512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becdd0b2-a1ba-4761-848b-6bb04f22e81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386d0d7584764f55aa7750f5febe5996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:15Z,use_quota=True,user_id='e465f3ccd689403e935946385d50afc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Creating volume becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:15:28 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491b542e-5e03-4c22-b938-7b53c3d17e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c843c102-33c7-42c7-a912-4f263bc68f74', 'volume_size': 2, 'source_volid': 'c20e2500-8f8d-4d78-b7c1-9a575020ee5d', 'source_volstatus': 'available'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:28 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e 1073741824 Jul 09 03:15:28 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983c0913-9adb-4793-b5aa-bb2ec9ff6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:28 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Volume volume-c843c102-33c7-42c7-a912-4f263bc68f74 (c843c102-33c7-42c7-a912-4f263bc68f74): created successfully Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983c0913-9adb-4793-b5aa-bb2ec9ff6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Flow 'volume_create_manager' (496495ee-706d-4bf3-bf03-d82e5cd48ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:28 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-eb643e9f-c775-4372-8cea-c4734be4dbee tempest-VolumesCloneTest-1100222651 None] Created volume successfully. Jul 09 03:15:29 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.722s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:29 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:15:29 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Deleted volume successfully. Jul 09 03:15:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-234e4115-c685-492e-a5b4-121b6e88061f tempest-TestServerVolumeAttachmentScenario-423475292 None] Lock "cinder-21b2b120-c07a-481f-be12-2191ae783746-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Acquiring lock "cinder-c843c102-33c7-42c7-a912-4f263bc68f74-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Lock "cinder-c843c102-33c7-42c7-a912-4f263bc68f74-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Acquiring lock "cinder-quobyte-c843c102-33c7-42c7-a912-4f263bc68f74" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Lock "cinder-quobyte-c843c102-33c7-42c7-a912-4f263bc68f74" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57fb3c6-ee6c-4221-b836-e0acc1c73fd7]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:29 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e 1073741824" returned: 0 in 1.012s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:29 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74 Jul 09 03:15:29 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:29 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e Jul 09 03:15:29 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:30 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74" returned: 0 in 0.867s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:30 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e" returned: 0 in 0.719s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:30 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74 Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.084s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:30 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=87110842-c5c6-4c10-8b76-e987cd982625,created_at=2026-07-09T01:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-639591341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87110842-c5c6-4c10-8b76-e987cd982625,host='devstack@QuobyteHD#QuobyteHD',id=49371f74-5889-469b-966f-f4d349a2a3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fd88f03773467f99310071f046f629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:24Z,use_quota=True,user_id='58b9c720b6774c62803d1a8e696f8776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50ee0305-4927-4946-abca-04c694b0a80f),volume_type_id=50ee0305-4927-4946-abca-04c694b0a80f)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Creating volume 49371f74-5889-469b-966f-f4d349a2a3c7 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:15:30 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:30 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 1073741824 Jul 09 03:15:30 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Attempting download of ea6ec930-eba2-423b-9437-18da29841701 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}])) to volume becdd0b2-a1ba-4761-848b-6bb04f22e81e. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a042d1a-c15a-45f3-8ca7-ef8333cb6fbf]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_aw2m4j3x {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:30 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_aw2m4j3x Jul 09 03:15:30 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:31 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c843c102-33c7-42c7-a912-4f263bc68f74" returned: 0 in 0.830s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Lock "cinder-quobyte-c843c102-33c7-42c7-a912-4f263bc68f74" released by "delete_volume" :: held 1.739s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Created reservations ['c1271eaa-b2b4-4880-890e-e11a611131ad', '2a93e15c-6bd9-4b08-8317-ee36e1205b6d', '2bc235be-8895-476a-b160-2a3e9395240d', 'e548b95c-19a0-44a3-87f8-de20caa267dc'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:15:31 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 1073741824" returned: 0 in 0.994s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:31 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:31 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:31 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_aw2m4j3x" returned: 0 in 0.928s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_aw2m4j3x {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:31 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 Jul 09 03:15:31 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:31 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_aw2m4j3x Jul 09 03:15:31 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Acquiring lock "cinder-c20e2500-8f8d-4d78-b7c1-9a575020ee5d-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Lock "cinder-c20e2500-8f8d-4d78-b7c1-9a575020ee5d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Acquiring lock "cinder-quobyte-c20e2500-8f8d-4d78-b7c1-9a575020ee5d" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Lock "cinder-quobyte-c20e2500-8f8d-4d78-b7c1-9a575020ee5d" acquired by "delete_volume" :: waited 0.039s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[828312cc-cd39-46e9-a3b9-b31934ca5c98]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:32 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d Jul 09 03:15:32 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:32 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.960s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:15:32 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Deleted volume successfully. Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7" returned: 0 in 0.961s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:32 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dba1f3-839d-45b1-a134-48db4b814ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49371f74-5889-469b-966f-f4d349a2a3c7', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdddcd2-3d61-44f7-b07e-c6989df8a74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36bb9586-ea3e-4cd4-befb-0577af8a1824 tempest-VolumesCloneTest-1100222651 None] Lock "cinder-c843c102-33c7-42c7-a912-4f263bc68f74-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_aw2m4j3x" returned: 1 in 1.014s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea6ec930-eba2-423b-9437-18da29841701_aw2m4j3x' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[23353cd6-5469-481c-80c0-56e30e3648b6]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:32 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Volume volume-49371f74-5889-469b-966f-f4d349a2a3c7 (49371f74-5889-469b-966f-f4d349a2a3c7): created successfully Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdddcd2-3d61-44f7-b07e-c6989df8a74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Flow 'volume_create_manager' (d4c17581-70ca-4cd1-8002-1b52d0bfcf03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b497deb7-0df5-4938-b95c-983231d6539c tempest-GroupSnapshotsTest-1781209243 None] Created volume successfully. Jul 09 03:15:32 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD Jul 09 03:15:32 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:33 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d" returned: 0 in 1.069s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:33 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d Jul 09 03:15:33 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:33 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD" returned: 0 in 0.920s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:33 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] ea6ec930-eba2-423b-9437-18da29841701 was qcow2, converting to raw {{(pid=87216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:15:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:33 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e Jul 09 03:15:33 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:33 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c20e2500-8f8d-4d78-b7c1-9a575020ee5d" returned: 0 in 0.740s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Lock "cinder-quobyte-c20e2500-8f8d-4d78-b7c1-9a575020ee5d" released by "delete_volume" :: held 1.899s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Created reservations ['4f8b84bb-9c29-42b0-80f3-5cf3d9c5a93a', '55d22cce-e41e-4d00-8bbc-512f101b3107', '55bc1d52-610e-47c4-bfd9-59194d66e949', 'c11f24d3-2dd9-4dbe-8844-1bc0532269a3'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:15:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] GroupSnapshot 2e29c5bb-3474-4747-bd98-01f65fcc251d: creating. Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] Group snapshot 2e29c5bb-3474-4747-bd98-01f65fcc251d: creating. {{(pid=87216) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:34 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:15:34 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] Creating offline snapshot 92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 of volume 49371f74-5889-469b-966f-f4d349a2a3c7 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f92f56-e722-4a18-a678-d62059ef1f2d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:34 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 Jul 09 03:15:34 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:35 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.879s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:35 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:15:35 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Deleted volume successfully. Jul 09 03:15:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-844a4019-5c2f-4cde-b077-a425d50e6c01 tempest-VolumesCloneTest-1100222651 None] Lock "cinder-c20e2500-8f8d-4d78-b7c1-9a575020ee5d-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:35 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7" returned: 0 in 1.201s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:35 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 1G Jul 09 03:15:35 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:36 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e" returned: 0 in 2.735s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:36 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea6ec930-eba2-423b-9437-18da29841701_ngs2qhrzdevstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:15:36 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Converted 112.00 MB image at 40.91 MB/s Jul 09 03:15:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:36 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e 1G Jul 09 03:15:36 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:36 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 1G" returned: 0 in 1.261s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49371f74-5889-469b-966f-f4d349a2a3c7 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:36 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49371f74-5889-469b-966f-f4d349a2a3c7 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 Jul 09 03:15:36 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:37 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e 1G" returned: 0 in 0.923s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:37 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dcedb8-8871-4dd3-9fc9-30a752abca52]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:37 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e Jul 09 03:15:37 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:37 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49371f74-5889-469b-966f-f4d349a2a3c7 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8" returned: 0 in 0.853s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:37 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:15:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:37 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 Jul 09 03:15:37 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:38 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e" returned: 0 in 1.002s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:38 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e Jul 09 03:15:38 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Flow 'volume_create_manager' (cdd4680e-633e-4dea-b614-09839c226540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0024e2f9-7cba-4054-8168-9aa50d6864f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0024e2f9-7cba-4054-8168-9aa50d6864f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1066355567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f071538e-87e1-47d6-95d6-eaa6a1e82473,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b549fee66734d12aaebbc9b0a692209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:38Z,use_quota=True,user_id='52a2a72221a84f0ebe5a0bc12a5dabf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc04d8c5-a765-48d2-91d6-84c70ba70fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc04d8c5-a765-48d2-91d6-84c70ba70fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f951f5-3d11-49c2-8dcb-2869c870191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f951f5-3d11-49c2-8dcb-2869c870191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f071538e-87e1-47d6-95d6-eaa6a1e82473', 'volume_name': 'volume-f071538e-87e1-47d6-95d6-eaa6a1e82473', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce23ca85-6fe4-4852-a122-a59197fbeebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce23ca85-6fe4-4852-a122-a59197fbeebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82c2f89-abdd-4fdb-91d7-0ad985094b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:38 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Volume f071538e-87e1-47d6-95d6-eaa6a1e82473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f071538e-87e1-47d6-95d6-eaa6a1e82473', 'volume_size': 1} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:38 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8" returned: 0 in 0.884s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:38 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.info Jul 09 03:15:38 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:39 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e" returned: 1 in 0.825s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Downloaded image ea6ec930-eba2-423b-9437-18da29841701 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}])) to volume becdd0b2-a1ba-4761-848b-6bb04f22e81e successfully. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Temporary image ea6ec930-eba2-423b-9437-18da29841701 for user e465f3ccd689403e935946385d50afc0 is deleted. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Marking volume becdd0b2-a1ba-4761-848b-6bb04f22e81e as bootable. {{(pid=87216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Copying metadata from image ea6ec930-eba2-423b-9437-18da29841701 to becdd0b2-a1ba-4761-848b-6bb04f22e81e. {{(pid=87216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Creating volume glance metadata for volume becdd0b2-a1ba-4761-848b-6bb04f22e81e backed by image ea6ec930-eba2-423b-9437-18da29841701 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2454277c-c52a-42ec-b512-d22991e43192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e', 'volume_size': 1, 'image_id': 'ea6ec930-eba2-423b-9437-18da29841701', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea6ec930-eba2-423b-9437-18da29841701', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c35718c0d6cf4fc8959e0a042f76773c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea6ec930-eba2-423b-9437-18da29841701', 'created_at': datetime.datetime(2026, 7, 9, 0, 55, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea6ec930-eba2-423b-9437-18da29841701/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e84181-a80e-4b26-afb2-2d0271470bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:39 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Volume volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e (becdd0b2-a1ba-4761-848b-6bb04f22e81e): created successfully Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e84181-a80e-4b26-afb2-2d0271470bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Flow 'volume_create_manager' (04584474-ed9f-40f5-8b67-57369f47a4f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:39 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-52f66170-a3e7-48a2-84bd-e29ed7ede33f tempest-TestShelveInstance-1256418565 None] Created volume successfully. Jul 09 03:15:39 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.info" returned: 0 in 0.745s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:39 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:15:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:39 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.info Jul 09 03:15:39 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:40 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.info" returned: 0 in 0.675s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.733s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.566s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1066355567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f071538e-87e1-47d6-95d6-eaa6a1e82473,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b549fee66734d12aaebbc9b0a692209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:38Z,use_quota=True,user_id='52a2a72221a84f0ebe5a0bc12a5dabf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Creating volume f071538e-87e1-47d6-95d6-eaa6a1e82473 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:15:40 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:15:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:40 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473 1073741824 Jul 09 03:15:40 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:40 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d3976bfb-b853-452f-9a16-b01aef0bb33e tempest-GroupSnapshotsTest-1781209243 None] group_snapshot 2e29c5bb-3474-4747-bd98-01f65fcc251d: created successfully Jul 09 03:15:41 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473 1073741824" returned: 0 in 1.109s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:41 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473 Jul 09 03:15:41 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:42 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473" returned: 0 in 0.834s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.030s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8-422026ed-6eb0-4651-b3d5-51505ff29b48" by "_create_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82c2f89-abdd-4fdb-91d7-0ad985094b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f071538e-87e1-47d6-95d6-eaa6a1e82473', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a749aeb3-bd02-4290-9499-1b584b46d3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8-422026ed-6eb0-4651-b3d5-51505ff29b48" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Creating volume 422026ed-6eb0-4651-b3d5-51505ff29b48 from snapshot 92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 {{(pid=87216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-422026ed-6eb0-4651-b3d5-51505ff29b48" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:42 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Volume volume-f071538e-87e1-47d6-95d6-eaa6a1e82473 (f071538e-87e1-47d6-95d6-eaa6a1e82473): created successfully Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a749aeb3-bd02-4290-9499-1b584b46d3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Flow 'volume_create_manager' (cdd4680e-633e-4dea-b614-09839c226540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:42 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4b8170a6-2bf9-404b-9e54-9912f605875d tempest-VolumesListTestJSON-247993129 None] Created volume successfully. Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-422026ed-6eb0-4651-b3d5-51505ff29b48" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] snapshot: 92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8, volume: 422026ed-6eb0-4651-b3d5-51505ff29b48, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[56175019-c9a1-46cc-b4d4-74f531916adc]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:42 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 Jul 09 03:15:42 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:43 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8" returned: 0 in 0.904s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49371f74-5889-469b-966f-f4d349a2a3c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbad2ef1-74a1-4d67-878a-1e5fa13d208b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:15:43 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 Jul 09 03:15:43 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Flow 'volume_create_manager' (9af974a9-f0c6-436a-80dc-9ac8cdd4ee1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e22e8f-be10-493d-be0e-0c9846d18e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e22e8f-be10-493d-be0e-0c9846d18e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b04f976-1a8f-443a-b140-37749e7aa2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e45c23692564b818a57305f04dacb6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:43Z,use_quota=True,user_id='f48db20eb651443198200bedc4339d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6adc3a09-5481-42c4-9509-118d793fc15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6adc3a09-5481-42c4-9509-118d793fc15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cbab9f-04a7-4fa1-a4e1-c44eeaa54cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cbab9f-04a7-4fa1-a4e1-c44eeaa54cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b04f976-1a8f-443a-b140-37749e7aa2a6', 'volume_name': 'volume-5b04f976-1a8f-443a-b140-37749e7aa2a6', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda50178-d9a8-44ed-bcd4-cf84aa992ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda50178-d9a8-44ed-bcd4-cf84aa992ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d2dca8-3be7-41d0-b87c-c70ef3349f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:43 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Volume 5b04f976-1a8f-443a-b140-37749e7aa2a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b04f976-1a8f-443a-b140-37749e7aa2a6', 'volume_size': 1} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Flow 'volume_create_manager' (e9b0e89c-bb06-415f-bc83-214e732269e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c993421-1240-4d48-904e-2cf09901c4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=102,cinder:DELETE=8,cinder:SELECT=98,cinder:INSERT=30 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c993421-1240-4d48-904e-2cf09901c4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1672034742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fb8c30-8deb-4553-b746-5d4ae553b917,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b549fee66734d12aaebbc9b0a692209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:43Z,use_quota=True,user_id='52a2a72221a84f0ebe5a0bc12a5dabf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dec8d01-51dd-4a5f-9896-36c56db64764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dec8d01-51dd-4a5f-9896-36c56db64764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb099d2-b3f1-4d39-ac24-f434717be990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb099d2-b3f1-4d39-ac24-f434717be990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25fb8c30-8deb-4553-b746-5d4ae553b917', 'volume_name': 'volume-25fb8c30-8deb-4553-b746-5d4ae553b917', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4c98d2-9601-48d1-a60b-c3bfd1bde53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4c98d2-9601-48d1-a60b-c3bfd1bde53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2697f2e-6242-48e8-8c4a-c80439f1e403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:43 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Volume 25fb8c30-8deb-4553-b746-5d4ae553b917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25fb8c30-8deb-4553-b746-5d4ae553b917', 'volume_size': 1} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:43 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7" returned: 0 in 0.797s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48 not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:15:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:43 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48 Jul 09 03:15:43 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:48 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=90,cinder:UPDATE=100,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:15:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-d3a95c6b-ad8c-4457-a69d-759dd25092db req-f3ff1077-2928-4700-a5e3-3033cd13c645 tempest-TestShelveInstance-1256418565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:49 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48" returned: 0 in 5.713s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:49 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b20bc6-ddd9-4c1f-8567-b7e4edf92e20]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:49 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 Jul 09 03:15:49 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:50 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7" returned: 0 in 1.014s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:50 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:15:50 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Converted 1024.00 MB image at 179.21 MB/s Jul 09 03:15:50 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:15:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:50 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48 Jul 09 03:15:50 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:51 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48" returned: 0 in 0.674s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-422026ed-6eb0-4651-b3d5-51505ff29b48" released by "_copy_volume_from_snapshot" :: held 9.215s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8-422026ed-6eb0-4651-b3d5-51505ff29b48" released by "_create_volume_from_snapshot" :: held 9.289s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.331s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.042s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b04f976-1a8f-443a-b140-37749e7aa2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e45c23692564b818a57305f04dacb6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:43Z,use_quota=True,user_id='f48db20eb651443198200bedc4339d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Creating volume 5b04f976-1a8f-443a-b140-37749e7aa2a6 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:15:51 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:15:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:51 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6 1073741824 Jul 09 03:15:51 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:51 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5f8e41cd-3346-4b42-92d4-feaea205947d tempest-GroupSnapshotsTest-1781209243 None] Create group from source-snapshot-2e29c5bb-3474-4747-bd98-01f65fcc251d completed successfully. Jul 09 03:15:52 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6 1073741824" returned: 0 in 0.846s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:52 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6 Jul 09 03:15:52 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-422026ed-6eb0-4651-b3d5-51505ff29b48" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-422026ed-6eb0-4651-b3d5-51505ff29b48" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:52 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f010fe3-f836-4269-8a40-b2d6c30f87ad]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:53 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6" returned: 0 in 0.723s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.526s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1672034742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fb8c30-8deb-4553-b746-5d4ae553b917,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b549fee66734d12aaebbc9b0a692209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:43Z,use_quota=True,user_id='52a2a72221a84f0ebe5a0bc12a5dabf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Creating volume 25fb8c30-8deb-4553-b746-5d4ae553b917 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:15:53 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:53 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48 Jul 09 03:15:53 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:53 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917 1073741824 Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d2dca8-3be7-41d0-b87c-c70ef3349f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b04f976-1a8f-443a-b140-37749e7aa2a6', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:53 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971db3a0-c490-4af9-9479-b2187396b1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:53 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Volume volume-5b04f976-1a8f-443a-b140-37749e7aa2a6 (5b04f976-1a8f-443a-b140-37749e7aa2a6): created successfully Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971db3a0-c490-4af9-9479-b2187396b1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Flow 'volume_create_manager' (9af974a9-f0c6-436a-80dc-9ac8cdd4ee1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:53 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1eb72c09-f8b6-48c4-8068-893a7bce73c8 tempest-CinderUnicodeTest-1606922007 None] Created volume successfully. Jul 09 03:15:53 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48" returned: 0 in 0.871s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:53 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48 Jul 09 03:15:53 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:53 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917 1073741824" returned: 0 in 0.879s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:54 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917 Jul 09 03:15:54 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Flow 'volume_create_manager' (ca664721-0c82-45c6-84e2-6012556897cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e9fe28-9787-42b8-85f0-2d2bc46feade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e9fe28-9787-42b8-85f0-2d2bc46feade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-730786078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb981d8-2b8b-4035-ac2c-87860047951d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e45c23692564b818a57305f04dacb6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:54Z,use_quota=True,user_id='f48db20eb651443198200bedc4339d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556ad4ce-ae3f-415f-8e37-bf0ea765094c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556ad4ce-ae3f-415f-8e37-bf0ea765094c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e41b847-a620-45c4-b954-5c70143273bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e41b847-a620-45c4-b954-5c70143273bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfb981d8-2b8b-4035-ac2c-87860047951d', 'volume_name': 'volume-bfb981d8-2b8b-4035-ac2c-87860047951d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0574124e-bf6d-4eba-ac1a-4eb7b943632b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0574124e-bf6d-4eba-ac1a-4eb7b943632b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db24bcab-f01c-41ba-94ec-b8d9ddf93173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:54 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Volume bfb981d8-2b8b-4035-ac2c-87860047951d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfb981d8-2b8b-4035-ac2c-87860047951d', 'volume_size': 1} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:54 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-422026ed-6eb0-4651-b3d5-51505ff29b48" returned: 0 in 0.786s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-422026ed-6eb0-4651-b3d5-51505ff29b48" released by "delete_volume" :: held 1.697s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:54 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917" returned: 0 in 0.699s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-d3a95c6b-ad8c-4457-a69d-759dd25092db req-f3ff1077-2928-4700-a5e3-3033cd13c645 tempest-TestShelveInstance-1256418565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.579s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2697f2e-6242-48e8-8c4a-c80439f1e403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25fb8c30-8deb-4553-b746-5d4ae553b917', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc93e99a-0703-4e2b-aa64-2ed9fc3c1a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:54 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Volume volume-25fb8c30-8deb-4553-b746-5d4ae553b917 (25fb8c30-8deb-4553-b746-5d4ae553b917): created successfully Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc93e99a-0703-4e2b-aa64-2ed9fc3c1a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Flow 'volume_create_manager' (e9b0e89c-bb06-415f-bc83-214e732269e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce2b228-26cf-4f5a-b55e-7467f71b217c]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-d3a95c6b-ad8c-4457-a69d-759dd25092db req-f3ff1077-2928-4700-a5e3-3033cd13c645 tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:54 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-57a4d5bc-31fb-403a-ba52-d64f3aa44abb tempest-VolumesListTestJSON-247993129 None] Created volume successfully. Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['4a797b0e-9cef-4d87-bfc3-df34f0c93a9b'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:15:54 devstack cinder-volume[87216]: WARNING cinder.quota [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1590885805 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1590885805, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:15:54 devstack cinder-volume[87216]: WARNING cinder.quota [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1590885805 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1590885805, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['1147e44a-3117-4f87-8cfb-31c7cc6567a5', 'da7eb5bc-5a29-44a0-97d2-dd2fc3cdd2f0', '06f128a0-c1a1-40af-96be-b6deb9f7c0d2', '21bdf58d-2a2c-4bb2-bb56-774d1fef902f'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:15:54 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e Jul 09 03:15:54 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:54 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:15:54 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] group_snapshot 2e29c5bb-3474-4747-bd98-01f65fcc251d: deleting Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] group_snapshot 2e29c5bb-3474-4747-bd98-01f65fcc251d: deleting {{(pid=87216) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-49371f74-5889-469b-966f-f4d349a2a3c7" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-49371f74-5889-469b-966f-f4d349a2a3c7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Deleting offline snapshot 92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 of volume 49371f74-5889-469b-966f-f4d349a2a3c7 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] snapshot_file for this snap is: volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bf47ce-f20a-4642-9225-ff89d5c4b4c0]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:55 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-d3a95c6b-ad8c-4457-a69d-759dd25092db req-f3ff1077-2928-4700-a5e3-3033cd13c645 tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e" returned: 0 in 0.810s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-d3a95c6b-ad8c-4457-a69d-759dd25092db req-f3ff1077-2928-4700-a5e3-3033cd13c645 tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:55 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.709s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:55 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:15:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-43b75c95-0415-4b75-9228-f579db76cdf1 tempest-GroupSnapshotsTest-1781209243 None] Delete group completed successfully. Jul 09 03:15:55 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 Jul 09 03:15:55 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:55 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e Jul 09 03:15:55 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:15:56 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Flow 'volume_create_manager' (40557e8b-36c2-4a81-913e-569d19441ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a6f15e-607c-4811-80ae-4a190c16a4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8" returned: 0 in 0.922s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49371f74-5889-469b-966f-f4d349a2a3c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:15:56 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b816d759-00ee-4ca3-990f-a3050845b666]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-d3a95c6b-ad8c-4457-a69d-759dd25092db req-f3ff1077-2928-4700-a5e3-3033cd13c645 tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e" returned: 1 in 0.920s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-d3a95c6b-ad8c-4457-a69d-759dd25092db req-f3ff1077-2928-4700-a5e3-3033cd13c645 tempest-TestShelveInstance-1256418565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a6f15e-607c-4811-80ae-4a190c16a4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-28538417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d28886a-8a2b-4393-9564-e29739bfcb37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b549fee66734d12aaebbc9b0a692209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:56Z,use_quota=True,user_id='52a2a72221a84f0ebe5a0bc12a5dabf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ebf506-02e6-44a8-a7b3-03ffa523191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ebf506-02e6-44a8-a7b3-03ffa523191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779bd6e7-8489-48c9-b975-c5966480346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779bd6e7-8489-48c9-b975-c5966480346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d28886a-8a2b-4393-9564-e29739bfcb37', 'volume_name': 'volume-1d28886a-8a2b-4393-9564-e29739bfcb37', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b6adf7-cdb4-4d37-8e97-b38edbc714ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b6adf7-cdb4-4d37-8e97-b38edbc714ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b730a759-ff72-48d3-8056-f372228cd955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:56 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Volume 1d28886a-8a2b-4393-9564-e29739bfcb37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d28886a-8a2b-4393-9564-e29739bfcb37', 'volume_size': 1} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-d3a95c6b-ad8c-4457-a69d-759dd25092db req-f3ff1077-2928-4700-a5e3-3033cd13c645 tempest-TestShelveInstance-1256418565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.845s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.121s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-730786078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb981d8-2b8b-4035-ac2c-87860047951d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e45c23692564b818a57305f04dacb6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:54Z,use_quota=True,user_id='f48db20eb651443198200bedc4339d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Creating volume bfb981d8-2b8b-4035-ac2c-87860047951d {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:15:56 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:56 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d 1073741824 Jul 09 03:15:56 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-d3a95c6b-ad8c-4457-a69d-759dd25092db req-f3ff1077-2928-4700-a5e3-3033cd13c645 tempest-TestShelveInstance-1256418565 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '020ca4d6-d739-4113-b991-c992093f1059', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:15:56 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 Jul 09 03:15:56 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:56 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-d3a95c6b-ad8c-4457-a69d-759dd25092db req-f3ff1077-2928-4700-a5e3-3033cd13c645 tempest-TestShelveInstance-1256418565 None] attachment_update completed successfully. Jul 09 03:15:57 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7" returned: 0 in 0.825s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:57 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 Jul 09 03:15:57 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:57 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d 1073741824" returned: 0 in 0.926s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:57 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d Jul 09 03:15:57 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:58 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8" returned: 0 in 0.762s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:58 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8 Jul 09 03:15:58 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:58 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d" returned: 0 in 0.676s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.685s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-28538417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d28886a-8a2b-4393-9564-e29739bfcb37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b549fee66734d12aaebbc9b0a692209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:15:56Z,use_quota=True,user_id='52a2a72221a84f0ebe5a0bc12a5dabf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Creating volume 1d28886a-8a2b-4393-9564-e29739bfcb37 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:15:58 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db24bcab-f01c-41ba-94ec-b8d9ddf93173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb981d8-2b8b-4035-ac2c-87860047951d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:58 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37 1073741824 Jul 09 03:15:58 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328183dc-171e-44ec-bb4a-a7d83a09134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:15:58 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Volume volume-bfb981d8-2b8b-4035-ac2c-87860047951d (bfb981d8-2b8b-4035-ac2c-87860047951d): created successfully Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328183dc-171e-44ec-bb4a-a7d83a09134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Flow 'volume_create_manager' (ca664721-0c82-45c6-84e2-6012556897cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:15:58 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2e5274aa-2dfe-4a2e-9d93-a16ae6baf541 tempest-CinderUnicodeTest-1606922007 None] Created volume successfully. Jul 09 03:15:58 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7.92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8" returned: 0 in 0.846s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:58 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-92e2b07c-ac12-4f48-a1ec-d56fd6e2d4b8" released by "_delete_snapshot" :: held 3.517s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-49371f74-5889-469b-966f-f4d349a2a3c7" released by "delete_snapshot" :: held 3.550s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:15:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:15:59 devstack cinder-volume[87216]: WARNING cinder.quota [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1590885805 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1590885805, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:15:59 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['78ec312e-3f5d-4378-8862-b6f924ad2372', '733e0a7d-39f2-47af-a20e-35fca6397b24', '5b38e7c6-afef-4d68-b1a4-d94457f02791', '24d0cb24-e4aa-42cc-82ef-390a4ce08cf2'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:15:59 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-38413e2b-c87c-4f21-9306-f96be09a80dc tempest-GroupSnapshotsTest-1781209243 None] group_snapshot 2e29c5bb-3474-4747-bd98-01f65fcc251d: deleted successfully Jul 09 03:15:59 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37 1073741824" returned: 0 in 1.096s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:15:59 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37 Jul 09 03:15:59 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:15:59 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 09 03:15:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37" returned: 0 in 0.658s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:15:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:15:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.900s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b730a759-ff72-48d3-8056-f372228cd955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d28886a-8a2b-4393-9564-e29739bfcb37', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c0e035-1291-486d-bfde-1552a2612136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] Creating offline snapshot 06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 of volume bfb981d8-2b8b-4035-ac2c-87860047951d {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:16:00 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Volume volume-1d28886a-8a2b-4393-9564-e29739bfcb37 (1d28886a-8a2b-4393-9564-e29739bfcb37): created successfully Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c0e035-1291-486d-bfde-1552a2612136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Flow 'volume_create_manager' (40557e8b-36c2-4a81-913e-569d19441ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd71aa02-3c82-45e2-9fc9-e4f618792927]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:00 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-351aab23-e1b2-4116-aaeb-548199f016ea tempest-VolumesListTestJSON-247993129 None] Created volume successfully. Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-49371f74-5889-469b-966f-f4d349a2a3c7" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-49371f74-5889-469b-966f-f4d349a2a3c7" acquired by "delete_volume" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:00 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d Jul 09 03:16:00 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f2665e-02ad-49b9-9427-4ffb46642b84]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:00 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 Jul 09 03:16:00 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:01 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d" returned: 0 in 1.335s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:01 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 1G Jul 09 03:16:01 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:01 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7" returned: 0 in 1.287s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:01 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7 Jul 09 03:16:01 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:02 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49371f74-5889-469b-966f-f4d349a2a3c7" returned: 0 in 0.824s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:02 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 1G" returned: 0 in 1.025s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfb981d8-2b8b-4035-ac2c-87860047951d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-49371f74-5889-469b-966f-f4d349a2a3c7" released by "delete_volume" :: held 2.285s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:02 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfb981d8-2b8b-4035-ac2c-87860047951d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 Jul 09 03:16:02 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['72842e7b-d72e-46f6-b0c8-5319ae9d6508'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:02 devstack cinder-volume[87216]: WARNING cinder.db.api [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1590885805'] Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['7bb31e58-6e9e-4ca7-a87f-5608bccad9af', 'df24b732-8f33-415d-accb-4d20fc11bbc9', '97fedc76-aad5-4fe1-87f2-d1bc4d481f86', 'bfbe17cf-da27-4507-9427-3caff6d981f5'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:03 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:16:03 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:03 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfb981d8-2b8b-4035-ac2c-87860047951d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6" returned: 0 in 1.236s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:03 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 is being set with open permissions: ugo+rw Jul 09 03:16:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Acquiring lock "cinder-1d28886a-8a2b-4393-9564-e29739bfcb37-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:03 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 Jul 09 03:16:03 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Lock "cinder-1d28886a-8a2b-4393-9564-e29739bfcb37-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Acquiring lock "cinder-quobyte-1d28886a-8a2b-4393-9564-e29739bfcb37" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:03 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8ef2cc75-8825-4634-9f34-a79b217b3028 tempest-GroupSnapshotsTest-1781209243 None] Group tempest-GroupSnapshotsTest-Group-1517434641: creating Jul 09 03:16:04 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Lock "cinder-quobyte-1d28886a-8a2b-4393-9564-e29739bfcb37" acquired by "delete_volume" :: waited 0.063s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:04 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfb3707-7521-422b-9ed7-63c307d622d9]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:04 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8ef2cc75-8825-4634-9f34-a79b217b3028 tempest-GroupSnapshotsTest-1781209243 None] Group tempest-GroupSnapshotsTest-Group-1517434641: created successfully Jul 09 03:16:04 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8ef2cc75-8825-4634-9f34-a79b217b3028 tempest-GroupSnapshotsTest-1781209243 None] Create group completed successfully. Jul 09 03:16:04 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.225s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:04 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:16:04 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a211a1c9-1ccf-4bef-8cbe-60fb72dd072a tempest-GroupSnapshotsTest-1781209243 None] Delete group completed successfully. Jul 09 03:16:04 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37 Jul 09 03:16:04 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:04 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6" returned: 0 in 1.137s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:04 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.info Jul 09 03:16:04 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:05 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37" returned: 0 in 1.287s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:05 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37 Jul 09 03:16:05 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Flow 'volume_create_manager' (bcac5872-560e-4925-ac92-a115f7f36040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76f1575-7342-489f-9ce1-b56712f904f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76f1575-7342-489f-9ce1-b56712f904f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1619374117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea2ea903-0216-43be-a46d-5c78b49b3779,host='devstack@QuobyteHD#QuobyteHD',id=49f49efb-5b1e-4783-a7c8-6b666b0d0fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fd88f03773467f99310071f046f629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:16:06Z,use_quota=True,user_id='58b9c720b6774c62803d1a8e696f8776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cfa12d9-f485-4bb5-8bf2-bb5e7ae49623),volume_type_id=1cfa12d9-f485-4bb5-8bf2-bb5e7ae49623)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318b708a-08fe-414b-a888-2878e5e43aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318b708a-08fe-414b-a888-2878e5e43aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4c5c5d-e97e-4e68-8363-72b365b8b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4c5c5d-e97e-4e68-8363-72b365b8b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f49efb-5b1e-4783-a7c8-6b666b0d0fb9', 'volume_name': 'volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afd00d4-ff75-40b8-ad33-d79c660d1226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afd00d4-ff75-40b8-ad33-d79c660d1226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:06 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67bc1c2-cb7c-4833-881d-c4194b8b8fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:06 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Volume 49f49efb-5b1e-4783-a7c8-6b666b0d0fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9', 'volume_size': 1} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.info" returned: 0 in 1.379s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:06 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.info is being set with open permissions: ugo+rw Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:06 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.info Jul 09 03:16:06 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:06 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d28886a-8a2b-4393-9564-e29739bfcb37" returned: 0 in 1.183s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Lock "cinder-quobyte-1d28886a-8a2b-4393-9564-e29739bfcb37" released by "delete_volume" :: held 2.556s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Created reservations ['52d571ce-99e1-4498-bc75-e52ac8c01b77', '2d34bfbc-8a7a-4279-adc2-09ee7740ab0a', '5fb9efaf-2a46-4a00-a68d-9b04c5876d99', 'bcea07c8-0a35-4f50-9e0f-dbc9478b1b5e'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:06 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:16:06 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:06 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.info" returned: 0 in 0.718s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.753s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea2ea903-0216-43be-a46d-5c78b49b3779,created_at=2026-07-09T01:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1619374117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea2ea903-0216-43be-a46d-5c78b49b3779,host='devstack@QuobyteHD#QuobyteHD',id=49f49efb-5b1e-4783-a7c8-6b666b0d0fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fd88f03773467f99310071f046f629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:16:06Z,use_quota=True,user_id='58b9c720b6774c62803d1a8e696f8776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cfa12d9-f485-4bb5-8bf2-bb5e7ae49623),volume_type_id=1cfa12d9-f485-4bb5-8bf2-bb5e7ae49623)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Creating volume 49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:16:07 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:07 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 1073741824 Jul 09 03:16:07 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:07 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4776fa27-e0fa-42a4-860e-ab307f56823d tempest-CinderUnicodeTest-1606922007 None] Create snapshot completed successfully Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Acquiring lock "cinder-25fb8c30-8deb-4553-b746-5d4ae553b917-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:07 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.982s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Lock "cinder-25fb8c30-8deb-4553-b746-5d4ae553b917-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:07 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Deleted volume successfully. Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-01c16cbd-b3a1-4eb3-b23c-c3f475f53fff tempest-VolumesListTestJSON-247993129 None] Lock "cinder-1d28886a-8a2b-4393-9564-e29739bfcb37-delete_volume" released by "delete_volume" :: held 4.040s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Acquiring lock "cinder-quobyte-25fb8c30-8deb-4553-b746-5d4ae553b917" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Lock "cinder-quobyte-25fb8c30-8deb-4553-b746-5d4ae553b917" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf961fff-3994-43e2-b392-9a7134d78268]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "cinder-06a4d1e0-0790-4b74-9a9c-0ce579e0aba6-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-06a4d1e0-0790-4b74-9a9c-0ce579e0aba6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "cinder-quobyte-bfb981d8-2b8b-4035-ac2c-87860047951d" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-quobyte-bfb981d8-2b8b-4035-ac2c-87860047951d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "cinder-quobyte-06a4d1e0-0790-4b74-9a9c-0ce579e0aba6" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-quobyte-06a4d1e0-0790-4b74-9a9c-0ce579e0aba6" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Deleting offline snapshot 06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 of volume bfb981d8-2b8b-4035-ac2c-87860047951d {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:16:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] snapshot_file for this snap is: volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:16:08 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[433b27dc-79ec-4957-bce2-bd43904692e6]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:08 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917 Jul 09 03:16:08 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:08 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 Jul 09 03:16:08 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:08 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 1073741824" returned: 0 in 1.938s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:09 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 Jul 09 03:16:09 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:09 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917" returned: 0 in 1.466s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:09 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917 Jul 09 03:16:09 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:09 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6" returned: 0 in 1.268s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfb981d8-2b8b-4035-ac2c-87860047951d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:16:09 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7fe000-95c7-4580-89c0-b638abf5537a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:09 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d Jul 09 03:16:09 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:09 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9" returned: 0 in 0.918s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] <== create_volume: return (2955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:16:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.958s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67bc1c2-cb7c-4833-881d-c4194b8b8fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376b4ab7-3a85-4391-9037-d9d7d7fd592d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:10 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Volume volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 (49f49efb-5b1e-4783-a7c8-6b666b0d0fb9): created successfully Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376b4ab7-3a85-4391-9037-d9d7d7fd592d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Flow 'volume_create_manager' (bcac5872-560e-4925-ac92-a115f7f36040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:16:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-68ff7ab0-ce14-4d7b-9c2a-a3494e7debe6 tempest-GroupSnapshotsTest-1781209243 None] Created volume successfully. Jul 09 03:16:10 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-25fb8c30-8deb-4553-b746-5d4ae553b917" returned: 0 in 0.956s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Lock "cinder-quobyte-25fb8c30-8deb-4553-b746-5d4ae553b917" released by "delete_volume" :: held 2.509s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Created reservations ['69a4b900-8ae9-4bdc-9632-b5628986e76f', 'e9202a9e-9a25-4f5b-bea1-eeb3e357944c', '778e9932-8dc5-4721-b8e0-0e69d0bee69c', '91fdd871-c454-43bc-aa08-3c58edd5a7a9'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:10 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:16:10 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:10 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d" returned: 0 in 1.164s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:10 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 Jul 09 03:16:10 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:11 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.899s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:11 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:16:11 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Deleted volume successfully. Jul 09 03:16:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-628e1f4d-1c01-4dda-9939-0db48ce3d76f tempest-VolumesListTestJSON-247993129 None] Lock "cinder-25fb8c30-8deb-4553-b746-5d4ae553b917-delete_volume" released by "delete_volume" :: held 3.800s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Acquiring lock "cinder-f071538e-87e1-47d6-95d6-eaa6a1e82473-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Lock "cinder-f071538e-87e1-47d6-95d6-eaa6a1e82473-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Acquiring lock "cinder-quobyte-f071538e-87e1-47d6-95d6-eaa6a1e82473" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Lock "cinder-quobyte-f071538e-87e1-47d6-95d6-eaa6a1e82473" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:11 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[976b387a-d434-4c8e-bd1d-6a89cf7c005e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:11 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473 Jul 09 03:16:11 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:11 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6" returned: 0 in 1.269s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:12 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6 Jul 09 03:16:12 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Flow 'volume_create_manager' (f709c20b-cc8a-4693-839e-756270f7733d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6948c9b-66be-4c1c-b09d-9d778dcc8623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6948c9b-66be-4c1c-b09d-9d778dcc8623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1699449106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea2ea903-0216-43be-a46d-5c78b49b3779,host='devstack@QuobyteHD#QuobyteHD',id=111990d1-02a0-4465-b4ab-8eb88f69c83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fd88f03773467f99310071f046f629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:16:12Z,use_quota=True,user_id='58b9c720b6774c62803d1a8e696f8776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cfa12d9-f485-4bb5-8bf2-bb5e7ae49623),volume_type_id=1cfa12d9-f485-4bb5-8bf2-bb5e7ae49623)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804aa977-4b27-444e-84d4-9a57607ec3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804aa977-4b27-444e-84d4-9a57607ec3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182a82e7-0097-4ceb-a925-217953c3ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182a82e7-0097-4ceb-a925-217953c3ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111990d1-02a0-4465-b4ab-8eb88f69c83a', 'volume_name': 'volume-111990d1-02a0-4465-b4ab-8eb88f69c83a', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfff402-0a65-4385-9a94-f1f870690007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfff402-0a65-4385-9a94-f1f870690007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53a2ae3-7fc1-425e-b06f-3b310b0079d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:12 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Volume 111990d1-02a0-4465-b4ab-8eb88f69c83a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111990d1-02a0-4465-b4ab-8eb88f69c83a', 'volume_size': 1} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea2ea903-0216-43be-a46d-5c78b49b3779,created_at=2026-07-09T01:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1699449106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea2ea903-0216-43be-a46d-5c78b49b3779,host='devstack@QuobyteHD#QuobyteHD',id=111990d1-02a0-4465-b4ab-8eb88f69c83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fd88f03773467f99310071f046f629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:16:12Z,use_quota=True,user_id='58b9c720b6774c62803d1a8e696f8776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cfa12d9-f485-4bb5-8bf2-bb5e7ae49623),volume_type_id=1cfa12d9-f485-4bb5-8bf2-bb5e7ae49623)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Creating volume 111990d1-02a0-4465-b4ab-8eb88f69c83a {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:16:12 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:12 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a 1073741824 Jul 09 03:16:12 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:12 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473" returned: 0 in 1.252s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:13 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d.06a4d1e0-0790-4b74-9a9c-0ce579e0aba6" returned: 0 in 1.045s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:13 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473 Jul 09 03:16:13 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-quobyte-06a4d1e0-0790-4b74-9a9c-0ce579e0aba6" released by "_delete_snapshot" :: held 4.964s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-quobyte-bfb981d8-2b8b-4035-ac2c-87860047951d" released by "delete_snapshot" :: held 5.027s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Created reservations ['6a089274-ab0c-4dc3-a1cf-3cb411221bf1', 'add45af1-a68a-48b5-b00d-5e52276532d0', '85033430-20cf-4d53-8ffa-a840d9fbe181', '93f206e3-35d1-4fd3-96cd-f592d1cf7c6b'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Delete snapshot completed successfully. Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-669711fa-1b41-42aa-967b-e4c1ba245c84 tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-06a4d1e0-0790-4b74-9a9c-0ce579e0aba6-delete_snapshot" released by "delete_snapshot" :: held 5.358s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "cinder-bfb981d8-2b8b-4035-ac2c-87860047951d-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-bfb981d8-2b8b-4035-ac2c-87860047951d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "cinder-quobyte-bfb981d8-2b8b-4035-ac2c-87860047951d" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-quobyte-bfb981d8-2b8b-4035-ac2c-87860047951d" acquired by "delete_volume" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[79599b78-4d76-4fb6-8162-647a6897c01a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:13 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:16:13 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:14 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f071538e-87e1-47d6-95d6-eaa6a1e82473" returned: 0 in 1.064s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Lock "cinder-quobyte-f071538e-87e1-47d6-95d6-eaa6a1e82473" released by "delete_volume" :: held 2.372s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:14 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a 1073741824" returned: 0 in 1.418s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:14 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d Jul 09 03:16:14 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:14 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Created reservations ['c5101542-6500-49c1-a417-0e00cdbf900e', 'ba3b17de-3b6c-4e19-9a89-96291391b02d', '5b9c54d7-e924-4bdb-9779-0fb5a7bf9692', 'b19bf424-99b0-424c-a4a6-bca6859e96ce'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:14 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a Jul 09 03:16:14 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:14 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:14 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:14 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:16:14 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:15 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a" returned: 0 in 1.175s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] <== create_volume: return (2673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.681s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:15 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.545s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:16:15 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53a2ae3-7fc1-425e-b06f-3b310b0079d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111990d1-02a0-4465-b4ab-8eb88f69c83a', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:15 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62e0bcc-08ab-4bc8-a491-2ff1df2aeda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.143s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d" returned: 0 in 1.583s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:15 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Deleted volume successfully. Jul 09 03:16:15 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Volume volume-111990d1-02a0-4465-b4ab-8eb88f69c83a (111990d1-02a0-4465-b4ab-8eb88f69c83a): created successfully Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62e0bcc-08ab-4bc8-a491-2ff1df2aeda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:15 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d Jul 09 03:16:15 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Flow 'volume_create_manager' (f709c20b-cc8a-4693-839e-756270f7733d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:16:15 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f18e5fde-7ca7-440d-a1a2-0c6cebfff295 tempest-GroupSnapshotsTest-1781209243 None] Created volume successfully. Jul 09 03:16:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1c1fa29-2a2e-4fa9-a086-bea7b3eb7138 tempest-VolumesListTestJSON-247993129 None] Lock "cinder-f071538e-87e1-47d6-95d6-eaa6a1e82473-delete_volume" released by "delete_volume" :: held 3.913s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:16 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-bfb981d8-2b8b-4035-ac2c-87860047951d" returned: 0 in 0.741s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-quobyte-bfb981d8-2b8b-4035-ac2c-87860047951d" released by "delete_volume" :: held 2.437s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:16 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Created reservations ['75486bdb-23d8-4b18-93c1-f98c5125baa1', 'bbb9b7d9-d058-45d6-bd98-23b54630e429', 'f5a04001-f64d-45bb-9d59-5856eac0f4d4', '4236909a-a902-4c0d-996d-13a17af58175'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:16 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:16:16 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:16 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-517093ff-912f-4e6d-b880-578ca0ca48a4 tempest-GroupSnapshotsTest-1781209243 None] Update group completed successfully. Jul 09 03:16:17 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.797s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:17 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:16:17 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Deleted volume successfully. Jul 09 03:16:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "cinder-5b04f976-1a8f-443a-b140-37749e7aa2a6-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8a303787-89d4-4c70-8ac7-307a08b7d5dd tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-bfb981d8-2b8b-4035-ac2c-87860047951d-delete_volume" released by "delete_volume" :: held 3.552s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-5b04f976-1a8f-443a-b140-37749e7aa2a6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "cinder-quobyte-5b04f976-1a8f-443a-b140-37749e7aa2a6" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-quobyte-5b04f976-1a8f-443a-b140-37749e7aa2a6" acquired by "delete_volume" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:17 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d9b1a1-eb6c-4b55-a731-740a5d5e7e8a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:17 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6 Jul 09 03:16:17 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:18 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a12d2cd7-1383-4e66-a5f2-97b915e03480 tempest-GroupSnapshotsTest-1781209243 None] Update group completed successfully. Jul 09 03:16:18 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6" returned: 0 in 0.895s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:18 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6 Jul 09 03:16:18 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Flow 'volume_create_manager' (306ceb59-2eea-4362-9f91-93d1c020b215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7ec816-218e-4707-8387-bb6166123b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7ec816-218e-4707-8387-bb6166123b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-268762765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a004d636-ef1f-4786-8cfc-08a3ba04c3f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321169d7761b4533918e047aea4aa049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:16:19Z,use_quota=True,user_id='a34e5f14c4b34309ad402e869cb766dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b895a3-1ea2-444b-9efa-17a133dbd762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b895a3-1ea2-444b-9efa-17a133dbd762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969897ff-93e9-412f-bbf7-d738a2f6f1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969897ff-93e9-412f-bbf7-d738a2f6f1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a004d636-ef1f-4786-8cfc-08a3ba04c3f3', 'volume_name': 'volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5de890-d315-433f-afcf-b0f8ceb206f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5de890-d315-433f-afcf-b0f8ceb206f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a713e6d-c895-487b-b603-ccc41153cbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:18 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Volume a004d636-ef1f-4786-8cfc-08a3ba04c3f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3', 'volume_size': 1} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-268762765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a004d636-ef1f-4786-8cfc-08a3ba04c3f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321169d7761b4533918e047aea4aa049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:16:19Z,use_quota=True,user_id='a34e5f14c4b34309ad402e869cb766dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Creating volume a004d636-ef1f-4786-8cfc-08a3ba04c3f3 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:16:18 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:18 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3 1073741824 Jul 09 03:16:18 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:18 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5b04f976-1a8f-443a-b140-37749e7aa2a6" returned: 0 in 0.777s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-quobyte-5b04f976-1a8f-443a-b140-37749e7aa2a6" released by "delete_volume" :: held 1.755s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:19 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Created reservations ['1ca4c6ea-6171-46c7-b2c3-e0ad92c84ff0', 'e52cb12f-ad3e-4625-8f07-e9cb4febeece', '6fa38ad0-a164-4a2b-a406-95547625a884', '2968da80-896e-4c40-8464-696695657d71'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:19 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:16:19 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:19 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2f6aa6d6-2a55-4a2f-8d6b-0fcf9e7c1cfd tempest-GroupSnapshotsTest-1781209243 None] Update group completed successfully. Jul 09 03:16:19 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3 1073741824" returned: 0 in 1.085s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:19 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3 Jul 09 03:16:19 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:20 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.838s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:20 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:16:20 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Deleted volume successfully. Jul 09 03:16:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-22216586-8c29-459d-920b-d79053087912 tempest-CinderUnicodeTest-1606922007 None] Lock "cinder-5b04f976-1a8f-443a-b140-37749e7aa2a6-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:20 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1f738efd-577b-4e2b-b28e-602bd3dbd202 tempest-GroupSnapshotsTest-1781209243 None] Update group completed successfully. Jul 09 03:16:20 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3" returned: 0 in 0.798s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:16:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a713e6d-c895-487b-b603-ccc41153cbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2957b3ed-2c74-409e-8ec6-169a58d41b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:20 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Volume volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3 (a004d636-ef1f-4786-8cfc-08a3ba04c3f3): created successfully Jul 09 03:16:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2957b3ed-2c74-409e-8ec6-169a58d41b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Flow 'volume_create_manager' (306ceb59-2eea-4362-9f91-93d1c020b215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:16:20 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7558852d-94e6-48a4-9acf-c290c77c9fa0 tempest-VolumesNegativeTest-1003651594 None] Created volume successfully. Jul 09 03:16:21 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] GroupSnapshot 045eb49b-b52a-40ad-a166-416f59811fa2: creating. Jul 09 03:16:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Group snapshot 045eb49b-b52a-40ad-a166-416f59811fa2: creating. {{(pid=87216) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 03:16:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Creating offline snapshot e9461368-041d-4aaf-bc03-5091852f2e7b of volume 49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:16:22 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d511915e-1234-4711-a5ea-e2415cbe59b4]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:22 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 Jul 09 03:16:22 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:22 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9" returned: 0 in 0.768s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:22 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b 1G Jul 09 03:16:22 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:23 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b 1G" returned: 0 in 0.821s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:23 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b Jul 09 03:16:23 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:24 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b" returned: 0 in 0.685s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:24 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:16:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:24 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b Jul 09 03:16:24 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:24 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b" returned: 0 in 0.633s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:25 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.info Jul 09 03:16:25 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:25 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.info" returned: 0 in 0.659s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:25 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:16:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:25 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.info Jul 09 03:16:25 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:26 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.info" returned: 0 in 0.712s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.360s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Creating offline snapshot f74642f6-82a4-483e-afcc-3f0423f65ca0 of volume 111990d1-02a0-4465-b4ab-8eb88f69c83a {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:16:26 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09baef0-d63c-412a-a200-968e00ee5b02]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:26 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a Jul 09 03:16:26 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:27 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a" returned: 0 in 0.803s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:27 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 1G Jul 09 03:16:27 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:28 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 1G" returned: 0 in 1.001s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111990d1-02a0-4465-b4ab-8eb88f69c83a -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:28 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111990d1-02a0-4465-b4ab-8eb88f69c83a -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 Jul 09 03:16:28 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:29 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111990d1-02a0-4465-b4ab-8eb88f69c83a -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0" returned: 0 in 0.847s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:29 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:16:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:29 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 Jul 09 03:16:29 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:29 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0" returned: 0 in 0.738s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:29 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.info Jul 09 03:16:29 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:30 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.info" returned: 0 in 0.679s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:30 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:16:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:30 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.info Jul 09 03:16:30 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:31 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.info" returned: 0 in 0.650s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.793s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:31 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9d83ed08-3bb2-4d90-82f1-1ef2ab0fc256 tempest-GroupSnapshotsTest-1781209243 None] group_snapshot 045eb49b-b52a-40ad-a166-416f59811fa2: created successfully Jul 09 03:16:31 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] group_snapshot 045eb49b-b52a-40ad-a166-416f59811fa2: deleting Jul 09 03:16:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] group_snapshot 045eb49b-b52a-40ad-a166-416f59811fa2: deleting {{(pid=87216) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 03:16:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-e9461368-041d-4aaf-bc03-5091852f2e7b" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-e9461368-041d-4aaf-bc03-5091852f2e7b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Deleting offline snapshot e9461368-041d-4aaf-bc03-5091852f2e7b of volume 49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:16:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] snapshot_file for this snap is: volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:16:31 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d288ac2-a64b-4461-a53e-b2d8cbb97c62]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:31 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b Jul 09 03:16:31 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:32 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b" returned: 0 in 0.945s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:16:32 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aa3b7c-b3c1-4a6c-a893-b88a401c563c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:32 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 Jul 09 03:16:32 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:33 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9" returned: 0 in 0.875s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:33 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b Jul 09 03:16:33 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:34 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b" returned: 0 in 0.908s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:34 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b Jul 09 03:16:34 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:35 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9.e9461368-041d-4aaf-bc03-5091852f2e7b" returned: 0 in 0.711s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-e9461368-041d-4aaf-bc03-5091852f2e7b" released by "_delete_snapshot" :: held 3.576s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9" released by "delete_snapshot" :: held 3.606s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-111990d1-02a0-4465-b4ab-8eb88f69c83a" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-111990d1-02a0-4465-b4ab-8eb88f69c83a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-f74642f6-82a4-483e-afcc-3f0423f65ca0" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-f74642f6-82a4-483e-afcc-3f0423f65ca0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Deleting offline snapshot f74642f6-82a4-483e-afcc-3f0423f65ca0 of volume 111990d1-02a0-4465-b4ab-8eb88f69c83a {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:16:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] snapshot_file for this snap is: volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:16:35 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d936751-9056-4bef-8a12-4490bb025d2c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:35 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 Jul 09 03:16:35 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:36 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0" returned: 0 in 0.854s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:36 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111990d1-02a0-4465-b4ab-8eb88f69c83a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:16:36 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac02ad8-c642-4382-b986-cd7b5d8930b6]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:36 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a Jul 09 03:16:36 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:37 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a" returned: 0 in 0.921s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:37 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 Jul 09 03:16:37 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:38 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0" returned: 0 in 1.206s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:38 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0 Jul 09 03:16:38 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-0ac4c100-4192-41c1-bf6a-89050c52cc91 req-e6145f50-fec2-491c-b556-3679b985c28d tempest-TestShelveInstance-1256418565 None] Terminate volume connection completed successfully. Jul 09 03:16:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-0ac4c100-4192-41c1-bf6a-89050c52cc91 req-e6145f50-fec2-491c-b556-3679b985c28d tempest-TestShelveInstance-1256418565 None] Deleting attachment 020ca4d6-d739-4113-b991-c992093f1059. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:16:39 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a.f74642f6-82a4-483e-afcc-3f0423f65ca0" returned: 0 in 0.936s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-f74642f6-82a4-483e-afcc-3f0423f65ca0" released by "_delete_snapshot" :: held 4.080s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-111990d1-02a0-4465-b4ab-8eb88f69c83a" released by "delete_snapshot" :: held 4.112s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:39 devstack cinder-volume[87216]: WARNING cinder.quota [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1127317928 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1127317928, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:16:39 devstack cinder-volume[87216]: WARNING cinder.quota [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1127317928 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1127317928, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:16:39 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['e54dd0f5-2683-48df-8cc2-e7dc9da5ee8d', '3944e5b1-c72d-48a0-9eac-766f8d830677', 'b66dd3e3-061b-44ca-a99f-653c8a1af887', '0615939e-444d-47a9-bb23-01ee9fad8fb7'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:39 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['4e629ee5-ba70-4ec5-81dc-30ad09234391', '17bb46b9-8540-4aaf-a422-bf9133c657bb', '3ec8e6a3-607b-4f8f-b9db-acc6a6833a4f', 'f0b10d4f-0e58-4ee6-a27c-b8e75826ea74'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:39 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0282c0bb-274e-462f-9f49-36caf38e94b3 tempest-GroupSnapshotsTest-1781209243 None] group_snapshot 045eb49b-b52a-40ad-a166-416f59811fa2: deleted successfully Jul 09 03:16:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-111990d1-02a0-4465-b4ab-8eb88f69c83a" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-111990d1-02a0-4465-b4ab-8eb88f69c83a" acquired by "delete_volume" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:41 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe0775f-3c8e-41c4-953a-37e398fffa3f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:41 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a Jul 09 03:16:41 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:42 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a" returned: 0 in 1.013s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:42 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a Jul 09 03:16:42 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:42 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-111990d1-02a0-4465-b4ab-8eb88f69c83a" returned: 0 in 0.671s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-111990d1-02a0-4465-b4ab-8eb88f69c83a" released by "delete_volume" :: held 1.815s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9" acquired by "delete_volume" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:42 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[524cfaed-2149-4220-bf97-69c03d5a89c7]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:43 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 Jul 09 03:16:43 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:43 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9" returned: 0 in 0.807s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:43 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9 Jul 09 03:16:43 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=112,cinder:UPDATE=112,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-b8bb9b37-eb30-43ab-9614-7506ad09828f req-d9fe663f-7338-416e-a8b2-10baf02924f6 tempest-TestShelveInstance-1256418565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-b8bb9b37-eb30-43ab-9614-7506ad09828f req-d9fe663f-7338-416e-a8b2-10baf02924f6 tempest-TestShelveInstance-1256418565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea38e409-0331-4298-81d4-fc33426b9c69]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-b8bb9b37-eb30-43ab-9614-7506ad09828f req-d9fe663f-7338-416e-a8b2-10baf02924f6 tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:44 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e Jul 09 03:16:44 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:44 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9" returned: 0 in 0.750s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-49f49efb-5b1e-4783-a7c8-6b666b0d0fb9" released by "delete_volume" :: held 1.628s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['5e07cd15-e14b-481b-ad22-74f1126cc2ac'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:44 devstack cinder-volume[87216]: WARNING cinder.quota [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1127317928 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1127317928, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['aa7c2236-00ba-4b27-a580-b393923e3c58', '9ab67989-d628-4788-9f4c-681554ba3447', '31cc70b1-8ea2-4a93-9484-7dedac6ae05e', '8b0d1db5-daf6-4d26-a111-5979b73147cb'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['d4b284a1-995e-4eec-b655-9dca188f7a63', 'd65ab411-d51a-4eff-a60a-65d594f009d0', 'fbae3db0-e265-42fa-b037-fdec41626871', '058a3d12-8f9f-4d93-bca9-1c6b017fa469'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:44 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:16:44 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:45 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-b8bb9b37-eb30-43ab-9614-7506ad09828f req-d9fe663f-7338-416e-a8b2-10baf02924f6 tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e" returned: 0 in 0.794s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-b8bb9b37-eb30-43ab-9614-7506ad09828f req-d9fe663f-7338-416e-a8b2-10baf02924f6 tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:45 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e Jul 09 03:16:45 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:45 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.762s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:45 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:16:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-36893325-2a35-45fd-8653-2582b0fc44e3 tempest-GroupSnapshotsTest-1781209243 None] Delete group completed successfully. Jul 09 03:16:46 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-b8bb9b37-eb30-43ab-9614-7506ad09828f req-d9fe663f-7338-416e-a8b2-10baf02924f6 tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e" returned: 1 in 0.899s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-b8bb9b37-eb30-43ab-9614-7506ad09828f req-d9fe663f-7338-416e-a8b2-10baf02924f6 tempest-TestShelveInstance-1256418565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:16:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-b8bb9b37-eb30-43ab-9614-7506ad09828f req-d9fe663f-7338-416e-a8b2-10baf02924f6 tempest-TestShelveInstance-1256418565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.769s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-b8bb9b37-eb30-43ab-9614-7506ad09828f req-d9fe663f-7338-416e-a8b2-10baf02924f6 tempest-TestShelveInstance-1256418565 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79881b32-74d2-4930-a969-4b0fa001a689', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:16:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-b8bb9b37-eb30-43ab-9614-7506ad09828f req-d9fe663f-7338-416e-a8b2-10baf02924f6 tempest-TestShelveInstance-1256418565 None] attachment_update completed successfully. Jul 09 03:16:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7cc071ed-e02d-4980-b6f3-a5ea74ca8772 tempest-GroupSnapshotsTest-1781209243 None] Group tempest-GroupSnapshotsTest-Group-146677513: creating Jul 09 03:16:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7cc071ed-e02d-4980-b6f3-a5ea74ca8772 tempest-GroupSnapshotsTest-1781209243 None] Group tempest-GroupSnapshotsTest-Group-146677513: created successfully Jul 09 03:16:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7cc071ed-e02d-4980-b6f3-a5ea74ca8772 tempest-GroupSnapshotsTest-1781209243 None] Create group completed successfully. Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Flow 'volume_create_manager' (f2558fee-867f-478b-93bd-4ce5f7d4faa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9edcdb2e-73a4-4be6-abec-a0647ad71d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9edcdb2e-73a4-4be6-abec-a0647ad71d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-915990962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=402be438-cffd-4b47-9900-4e6a7297d380,host='devstack@QuobyteHD#QuobyteHD',id=9a7e0a96-0d12-477b-b937-a09e142d62f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fd88f03773467f99310071f046f629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:16:48Z,use_quota=True,user_id='58b9c720b6774c62803d1a8e696f8776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(484d1a0a-3dbb-42c3-a9be-f67e1d6f860b),volume_type_id=484d1a0a-3dbb-42c3-a9be-f67e1d6f860b)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce65a2b-146d-4e15-a5fd-1a32efcaf171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce65a2b-146d-4e15-a5fd-1a32efcaf171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef3093d-5f1b-4a4b-82c3-5609cfb8a1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef3093d-5f1b-4a4b-82c3-5609cfb8a1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a7e0a96-0d12-477b-b937-a09e142d62f0', 'volume_name': 'volume-9a7e0a96-0d12-477b-b937-a09e142d62f0', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070e31d9-1aa4-4b61-bc77-41594906d237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070e31d9-1aa4-4b61-bc77-41594906d237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd82be98-791c-4158-8cf2-4cb2cfe8594c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:47 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Volume 9a7e0a96-0d12-477b-b937-a09e142d62f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a7e0a96-0d12-477b-b937-a09e142d62f0', 'volume_size': 1} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=402be438-cffd-4b47-9900-4e6a7297d380,created_at=2026-07-09T01:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-915990962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=402be438-cffd-4b47-9900-4e6a7297d380,host='devstack@QuobyteHD#QuobyteHD',id=9a7e0a96-0d12-477b-b937-a09e142d62f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fd88f03773467f99310071f046f629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:16:48Z,use_quota=True,user_id='58b9c720b6774c62803d1a8e696f8776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(484d1a0a-3dbb-42c3-a9be-f67e1d6f860b),volume_type_id=484d1a0a-3dbb-42c3-a9be-f67e1d6f860b)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Creating volume 9a7e0a96-0d12-477b-b937-a09e142d62f0 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:16:47 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:16:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:47 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 1073741824 Jul 09 03:16:47 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:48 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 1073741824" returned: 0 in 0.885s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:48 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=123,cinder:UPDATE=146,cinder:INSERT=29,cinder:DELETE=6 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:16:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:48 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 Jul 09 03:16:48 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:49 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0" returned: 0 in 0.761s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:16:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd82be98-791c-4158-8cf2-4cb2cfe8594c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a7e0a96-0d12-477b-b937-a09e142d62f0', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02db755-e813-4fae-bbf9-ed3334d4ad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:16:49 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Volume volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 (9a7e0a96-0d12-477b-b937-a09e142d62f0): created successfully Jul 09 03:16:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02db755-e813-4fae-bbf9-ed3334d4ad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:16:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Flow 'volume_create_manager' (f2558fee-867f-478b-93bd-4ce5f7d4faa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:16:49 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-eb508a05-6451-4603-abb1-1b8bc8b54cb7 tempest-GroupSnapshotsTest-1781209243 None] Created volume successfully. Jul 09 03:16:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] GroupSnapshot af8dcd10-0081-4466-9f8a-320f73b9cfb7: creating. Jul 09 03:16:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] Group snapshot af8dcd10-0081-4466-9f8a-320f73b9cfb7: creating. {{(pid=87216) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 03:16:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] Creating offline snapshot a737df36-17d0-4587-93e3-720bbde4a54f of volume 9a7e0a96-0d12-477b-b937-a09e142d62f0 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:16:50 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b3c981-c492-414f-bd55-0cd62586c1fc]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:50 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 Jul 09 03:16:50 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:51 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0" returned: 0 in 0.932s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:51 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f 1G Jul 09 03:16:51 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Acquiring lock "cinder-a004d636-ef1f-4786-8cfc-08a3ba04c3f3-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Lock "cinder-a004d636-ef1f-4786-8cfc-08a3ba04c3f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Acquiring lock "cinder-quobyte-a004d636-ef1f-4786-8cfc-08a3ba04c3f3" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Lock "cinder-quobyte-a004d636-ef1f-4786-8cfc-08a3ba04c3f3" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:52 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1001a2f-8ae7-4365-ab60-4f88f5646b9a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:52 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3 Jul 09 03:16:52 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:52 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f 1G" returned: 0 in 0.961s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:52 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f Jul 09 03:16:52 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:53 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3" returned: 0 in 0.832s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:53 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3 Jul 09 03:16:53 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:53 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f" returned: 0 in 0.785s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:53 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:53 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f Jul 09 03:16:53 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:53 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a004d636-ef1f-4786-8cfc-08a3ba04c3f3" returned: 0 in 0.703s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Lock "cinder-quobyte-a004d636-ef1f-4786-8cfc-08a3ba04c3f3" released by "delete_volume" :: held 1.579s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Created reservations ['57069338-9356-4e70-b3a6-bda2c90693c5', 'b2a5fec3-2f4c-41d5-b459-d1f0dd26e8c6', 'b32e3d44-42c6-450f-a9bc-967c8f8ebe26', 'af309d93-a5a3-47b8-8503-0170d6ab75fe'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:53 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f" returned: 0 in 0.745s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:53 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:16:53 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:54 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.info Jul 09 03:16:54 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:54 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.794s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:54 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:16:54 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Deleted volume successfully. Jul 09 03:16:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f490ed28-818b-45b2-803e-952f7daf3f84 tempest-VolumesNegativeTest-1003651594 None] Lock "cinder-a004d636-ef1f-4786-8cfc-08a3ba04c3f3-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:16:54 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.info" returned: 0 in 0.800s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:54 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 03:16:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:54 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.info Jul 09 03:16:54 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:55 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.info" returned: 0 in 0.901s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.238s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:16:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-71e4f0aa-d09f-41e5-907c-7ff36f790aa1 tempest-GroupSnapshotsTest-1781209243 None] group_snapshot af8dcd10-0081-4466-9f8a-320f73b9cfb7: created successfully Jul 09 03:16:56 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] group_snapshot af8dcd10-0081-4466-9f8a-320f73b9cfb7: deleting Jul 09 03:16:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] group_snapshot af8dcd10-0081-4466-9f8a-320f73b9cfb7: deleting {{(pid=87216) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 03:16:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-9a7e0a96-0d12-477b-b937-a09e142d62f0" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-9a7e0a96-0d12-477b-b937-a09e142d62f0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-a737df36-17d0-4587-93e3-720bbde4a54f" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:16:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-a737df36-17d0-4587-93e3-720bbde4a54f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:16:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Deleting offline snapshot a737df36-17d0-4587-93e3-720bbde4a54f of volume 9a7e0a96-0d12-477b-b937-a09e142d62f0 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:16:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] snapshot_file for this snap is: volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:16:57 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[23df650c-3272-4bf9-9b84-fddcb6a5da89]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:57 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f Jul 09 03:16:57 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:58 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f" returned: 0 in 0.987s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a7e0a96-0d12-477b-b937-a09e142d62f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:16:58 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1299c7a9-be1b-4a85-aec4-b25452b91c2f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:16:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:58 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 Jul 09 03:16:58 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:16:59 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 09 03:16:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0" returned: 0 in 1.034s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:16:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:16:59 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f Jul 09 03:16:59 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:00 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f" returned: 0 in 0.923s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:00 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f Jul 09 03:17:00 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:01 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0.a737df36-17d0-4587-93e3-720bbde4a54f" returned: 0 in 0.878s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-a737df36-17d0-4587-93e3-720bbde4a54f" released by "_delete_snapshot" :: held 3.991s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:17:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-9a7e0a96-0d12-477b-b937-a09e142d62f0" released by "delete_snapshot" :: held 4.040s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:17:01 devstack cinder-volume[87216]: WARNING cinder.quota [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1257797517 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1257797517, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:17:01 devstack cinder-volume[87216]: WARNING cinder.quota [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1257797517 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1257797517, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:17:01 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['366d47af-6d2e-40d2-a3e4-886bdc5ee921', '5d2c0f82-e2c2-4510-af0c-599ce8e13e16', 'ffbc64bb-82fd-45dd-afec-99e41b4e1c3b', '92623ed3-57b3-4c48-ae57-b6c628c689bd'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:17:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5197cd60-720f-4493-8cc1-f3ac01eb450e tempest-GroupSnapshotsTest-1781209243 None] group_snapshot af8dcd10-0081-4466-9f8a-320f73b9cfb7: deleted successfully Jul 09 03:17:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "cinder-quobyte-9a7e0a96-0d12-477b-b937-a09e142d62f0" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:17:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-9a7e0a96-0d12-477b-b937-a09e142d62f0" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:17:02 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[49170d0c-e413-4d93-8d55-2da227b7345d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:17:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:02 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 Jul 09 03:17:02 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:03 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0" returned: 0 in 1.041s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:03 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0 Jul 09 03:17:03 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:04 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9a7e0a96-0d12-477b-b937-a09e142d62f0" returned: 0 in 1.016s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:04 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Lock "cinder-quobyte-9a7e0a96-0d12-477b-b937-a09e142d62f0" released by "delete_volume" :: held 2.139s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:17:04 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['b45d840f-16ea-48c3-b7d3-648a911f0194'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:17:04 devstack cinder-volume[87216]: WARNING cinder.quota [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1257797517 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1257797517, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:17:04 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Created reservations ['a95c7197-ce4b-4b44-8cc6-1c7ec7576373', 'f02b02da-d83d-4810-adab-bcaa06c92cda', '58a3fea9-9935-4cc8-8b61-85d9a5692659', '443cf967-7d36-4144-88b1-dac3eaa663c5'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:17:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:17:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:17:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:04 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:17:04 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:05 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.944s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:05 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:17:05 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d4c2ce2e-7948-46e6-af4b-3a181e3033ec tempest-GroupSnapshotsTest-1781209243 None] Delete group completed successfully. Jul 09 03:17:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:17:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:17:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:17:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:13 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:17:13 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:14 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=50,cinder:INSERT=11,cinder:UPDATE=55,cinder:DELETE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:17:14 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=26,cinder:DELETE=1,cinder:SELECT=26,cinder:INSERT=9 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:17:14 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.778s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:17:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:17:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:17:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Flow 'volume_create_manager' (90069ce8-586f-43de-b37e-503476119011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a047bab6-81a7-45e3-b572-79fb21579487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a047bab6-81a7-45e3-b572-79fb21579487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1615228521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c28d59-2a53-435e-b2c6-89fd89787e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bb43df9fb54836b30ef42d0985b627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:17:20Z,use_quota=True,user_id='0f5e9e3346f34ac5a478aa7a721a8c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd7660f-2e39-4517-a8cb-0edf54667b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd7660f-2e39-4517-a8cb-0edf54667b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435651a3-6534-42a3-bb9e-b9e89729b398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435651a3-6534-42a3-bb9e-b9e89729b398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84c28d59-2a53-435e-b2c6-89fd89787e16', 'volume_name': 'volume-84c28d59-2a53-435e-b2c6-89fd89787e16', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56924d27-6c85-4812-a434-f30553032aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56924d27-6c85-4812-a434-f30553032aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1022899-81c1-40de-8249-b9be04a8ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:19 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Volume 84c28d59-2a53-435e-b2c6-89fd89787e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84c28d59-2a53-435e-b2c6-89fd89787e16', 'volume_size': 1} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1615228521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c28d59-2a53-435e-b2c6-89fd89787e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bb43df9fb54836b30ef42d0985b627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:17:20Z,use_quota=True,user_id='0f5e9e3346f34ac5a478aa7a721a8c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Creating volume 84c28d59-2a53-435e-b2c6-89fd89787e16 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:17:19 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:17:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:19 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16 1073741824 Jul 09 03:17:19 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:20 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16 1073741824" returned: 0 in 0.985s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:20 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16 Jul 09 03:17:20 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:21 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16" returned: 0 in 0.702s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:17:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1022899-81c1-40de-8249-b9be04a8ec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c28d59-2a53-435e-b2c6-89fd89787e16', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9b53ec-57af-4532-9e42-e2416c3b1d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:21 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Volume volume-84c28d59-2a53-435e-b2c6-89fd89787e16 (84c28d59-2a53-435e-b2c6-89fd89787e16): created successfully Jul 09 03:17:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9b53ec-57af-4532-9e42-e2416c3b1d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Flow 'volume_create_manager' (90069ce8-586f-43de-b37e-503476119011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:17:21 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f8871410-0a05-4d55-ab1a-cc44c72f834d tempest-VolumeQuotasAdminTestJSON-220840735 None] Created volume successfully. Jul 09 03:17:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Acquiring lock "cinder-84c28d59-2a53-435e-b2c6-89fd89787e16-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:17:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "cinder-84c28d59-2a53-435e-b2c6-89fd89787e16-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:17:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Acquiring lock "cinder-quobyte-84c28d59-2a53-435e-b2c6-89fd89787e16" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:17:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "cinder-quobyte-84c28d59-2a53-435e-b2c6-89fd89787e16" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:17:22 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb538bd-e140-4205-9493-1b9c4450882e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:17:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:22 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16 Jul 09 03:17:22 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:22 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16" returned: 0 in 0.791s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:22 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16 Jul 09 03:17:22 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:23 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-84c28d59-2a53-435e-b2c6-89fd89787e16" returned: 0 in 0.690s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "cinder-quobyte-84c28d59-2a53-435e-b2c6-89fd89787e16" released by "delete_volume" :: held 1.536s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:17:23 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Created reservations ['e02ba94d-e4a8-4d6b-ba72-d3f0b746d81d', 'e38a837f-1288-40f6-9c48-3c2f176c8857', 'd45123b8-3708-471b-b477-da679495add5', 'f0b66672-4d45-4887-bf0f-3808a048338d'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:17:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:17:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:17:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:23 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:17:23 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:24 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.647s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:17:24 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Deleted volume successfully. Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-32e57eba-5f18-46b9-8ed3-7f03bf8fc529 tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "cinder-84c28d59-2a53-435e-b2c6-89fd89787e16-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Flow 'volume_create_manager' (3636803b-153f-43f9-99b5-75b80c548a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6e1155-3baf-4b1b-8188-2901ac95d855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6e1155-3baf-4b1b-8188-2901ac95d855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1929375600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c11140c-f623-4c0a-855e-a2cfceae3c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bb43df9fb54836b30ef42d0985b627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:17:25Z,use_quota=True,user_id='0f5e9e3346f34ac5a478aa7a721a8c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03142dd7-ab15-46d7-bc48-a755229a5f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03142dd7-ab15-46d7-bc48-a755229a5f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e6019d-f4d5-4504-9e9f-4b96aa380012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e6019d-f4d5-4504-9e9f-4b96aa380012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c11140c-f623-4c0a-855e-a2cfceae3c74', 'volume_name': 'volume-4c11140c-f623-4c0a-855e-a2cfceae3c74', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b752f4-0eba-42e3-9d45-ff98f4873680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b752f4-0eba-42e3-9d45-ff98f4873680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3d6369-b34e-402c-9061-fb37908e9821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:24 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Volume 4c11140c-f623-4c0a-855e-a2cfceae3c74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c11140c-f623-4c0a-855e-a2cfceae3c74', 'volume_size': 1} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1929375600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c11140c-f623-4c0a-855e-a2cfceae3c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bb43df9fb54836b30ef42d0985b627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:17:25Z,use_quota=True,user_id='0f5e9e3346f34ac5a478aa7a721a8c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Creating volume 4c11140c-f623-4c0a-855e-a2cfceae3c74 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:17:24 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:17:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:24 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74 1073741824 Jul 09 03:17:24 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:25 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74 1073741824" returned: 0 in 0.810s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:25 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74 Jul 09 03:17:25 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:26 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74" returned: 0 in 0.664s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:17:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3d6369-b34e-402c-9061-fb37908e9821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c11140c-f623-4c0a-855e-a2cfceae3c74', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdd1618-5507-4db6-b02e-b67cccb81801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:26 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Volume volume-4c11140c-f623-4c0a-855e-a2cfceae3c74 (4c11140c-f623-4c0a-855e-a2cfceae3c74): created successfully Jul 09 03:17:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdd1618-5507-4db6-b02e-b67cccb81801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Flow 'volume_create_manager' (3636803b-153f-43f9-99b5-75b80c548a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:17:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4faea7bf-4056-439a-a3ea-eda4a65c2078 tempest-VolumeQuotasAdminTestJSON-220840735 None] Created volume successfully. Jul 09 03:17:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1f011e39-5f62-4cd2-a39f-40f02c6c220c tempest-VolumeQuotasAdminTestJSON-1661440952 None] Transfer volume completed successfully. Jul 09 03:17:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Acquiring lock "cinder-4c11140c-f623-4c0a-855e-a2cfceae3c74-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:17:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Lock "cinder-4c11140c-f623-4c0a-855e-a2cfceae3c74-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:17:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Acquiring lock "cinder-quobyte-4c11140c-f623-4c0a-855e-a2cfceae3c74" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:17:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Lock "cinder-quobyte-4c11140c-f623-4c0a-855e-a2cfceae3c74" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:17:28 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f901be2-2658-4086-bb9c-5ac4085d1793]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:17:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:28 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74 Jul 09 03:17:28 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:29 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74" returned: 0 in 0.809s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:29 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74 Jul 09 03:17:29 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:30 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4c11140c-f623-4c0a-855e-a2cfceae3c74" returned: 0 in 0.703s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Lock "cinder-quobyte-4c11140c-f623-4c0a-855e-a2cfceae3c74" released by "delete_volume" :: held 1.555s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:17:30 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Created reservations ['0724f7ca-720b-48a0-9a5e-34f703a73333', 'b61f53b3-eaa4-4448-9ea4-cdfd0a188ce8', 'e7bbc62a-c485-47e1-b20c-8198b8782ba2', '21ce8432-5495-430e-961c-fa1d59702fb5'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:17:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:17:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:17:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:30 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:17:30 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:31 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.807s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:31 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:17:31 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Deleted volume successfully. Jul 09 03:17:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3c8e6b60-71fb-4c8f-89bb-113b9cbcdbc1 tempest-VolumeQuotasAdminTestJSON-112727318 None] Lock "cinder-4c11140c-f623-4c0a-855e-a2cfceae3c74-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=14,cinder:INSERT=8,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Flow 'volume_create_manager' (b242814f-ef72-4b1e-999f-a868f870fef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e4116e-27ed-447a-9528-e9e90e0dcbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e4116e-27ed-447a-9528-e9e90e0dcbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1842446284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475eed7a-6edc-4eae-aa47-f998043b63fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a919428bbec42d799a9d74ef84202a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:17:41Z,use_quota=True,user_id='1cb075bb391047f49e5d7f8bfe0f844c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc27bf8-d749-4fef-980b-e0d41eae05d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc27bf8-d749-4fef-980b-e0d41eae05d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877373f2-08a1-410d-8e3f-6f8694c88e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877373f2-08a1-410d-8e3f-6f8694c88e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '475eed7a-6edc-4eae-aa47-f998043b63fb', 'volume_name': 'volume-475eed7a-6edc-4eae-aa47-f998043b63fb', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8609e99c-7c92-473f-82e7-1962d13db860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8609e99c-7c92-473f-82e7-1962d13db860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec75616-c085-484e-a812-e76b73210ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:40 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Volume 475eed7a-6edc-4eae-aa47-f998043b63fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-475eed7a-6edc-4eae-aa47-f998043b63fb', 'volume_size': 1} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1842446284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475eed7a-6edc-4eae-aa47-f998043b63fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a919428bbec42d799a9d74ef84202a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:17:41Z,use_quota=True,user_id='1cb075bb391047f49e5d7f8bfe0f844c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Creating volume 475eed7a-6edc-4eae-aa47-f998043b63fb {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:17:40 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:17:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:40 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb 1073741824 Jul 09 03:17:40 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:41 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-86d3e320-ab93-4ad1-b3b8-0e1c35c96f22 tempest-TestShelveInstance-1256418565 None] Terminate volume connection completed successfully. Jul 09 03:17:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-86d3e320-ab93-4ad1-b3b8-0e1c35c96f22 tempest-TestShelveInstance-1256418565 None] Deleting attachment 79881b32-74d2-4930-a969-4b0fa001a689. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:17:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Acquiring lock "cinder-becdd0b2-a1ba-4761-848b-6bb04f22e81e-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:17:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Lock "cinder-becdd0b2-a1ba-4761-848b-6bb04f22e81e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:17:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Acquiring lock "cinder-quobyte-becdd0b2-a1ba-4761-848b-6bb04f22e81e" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:17:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Lock "cinder-quobyte-becdd0b2-a1ba-4761-848b-6bb04f22e81e" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:17:42 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cae4d44-0a0f-4205-83b5-2afd8b2f2cd1]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:17:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:42 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb 1073741824" returned: 0 in 1.186s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:42 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e Jul 09 03:17:42 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:42 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb Jul 09 03:17:42 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:43 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e" returned: 0 in 1.097s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:43 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb" returned: 0 in 1.067s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] <== create_volume: return (2312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:17:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.317s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec75616-c085-484e-a812-e76b73210ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-475eed7a-6edc-4eae-aa47-f998043b63fb', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c45b3d-a676-4e34-b32c-127cd682c2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:43 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Volume volume-475eed7a-6edc-4eae-aa47-f998043b63fb (475eed7a-6edc-4eae-aa47-f998043b63fb): created successfully Jul 09 03:17:43 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e Jul 09 03:17:43 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c45b3d-a676-4e34-b32c-127cd682c2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Flow 'volume_create_manager' (b242814f-ef72-4b1e-999f-a868f870fef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:17:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-900f37c6-6952-42c2-b6be-a1c1204c2892 tempest-TestMinimumBasicScenario-76234117 None] Created volume successfully. Jul 09 03:17:44 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e" returned: 1 in 0.933s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:17:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:44 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e Jul 09 03:17:44 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:44 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-becdd0b2-a1ba-4761-848b-6bb04f22e81e" returned: 0 in 0.879s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Lock "cinder-quobyte-becdd0b2-a1ba-4761-848b-6bb04f22e81e" released by "delete_volume" :: held 3.032s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:17:45 devstack cinder-volume[87216]: DEBUG cinder.quota [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Created reservations ['b61c4fda-7531-49ef-bf77-1c3e478fded7', 'eb69ee57-8b84-4696-8a8a-cafa60bb0b42', 'e3a2441b-776b-4bab-a687-86f4453b7bae', '92006f00-4fc9-47a9-a0c3-0d1eb35be593'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:17:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:17:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:17:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:45 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:17:45 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:45 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.788s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:45 devstack cinder-volume[87216]: DEBUG cinder.manager [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:17:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Deleted volume successfully. Jul 09 03:17:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [req-671cacfb-2adc-427d-8dc9-2d93919b8ea9 req-091478b5-c4c4-4afa-b09a-3c6fe8082655 tempest-TestShelveInstance-1256418565 None] Lock "cinder-becdd0b2-a1ba-4761-848b-6bb04f22e81e-delete_volume" released by "delete_volume" :: held 4.081s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:17:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-2860b03e-2a9c-4387-a918-ec31720bd417 req-799cef79-e703-4e0c-b7d4-9b113040cd85 tempest-TestMinimumBasicScenario-76234117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-2860b03e-2a9c-4387-a918-ec31720bd417 req-799cef79-e703-4e0c-b7d4-9b113040cd85 tempest-TestMinimumBasicScenario-76234117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:47 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ae98f3-e378-4b85-9825-00ada7e798c7]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:17:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-2860b03e-2a9c-4387-a918-ec31720bd417 req-799cef79-e703-4e0c-b7d4-9b113040cd85 tempest-TestMinimumBasicScenario-76234117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:48 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb Jul 09 03:17:48 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:17:48 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jul 09 03:17:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-2860b03e-2a9c-4387-a918-ec31720bd417 req-799cef79-e703-4e0c-b7d4-9b113040cd85 tempest-TestMinimumBasicScenario-76234117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb" returned: 0 in 1.069s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:17:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-2860b03e-2a9c-4387-a918-ec31720bd417 req-799cef79-e703-4e0c-b7d4-9b113040cd85 tempest-TestMinimumBasicScenario-76234117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.095s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-2860b03e-2a9c-4387-a918-ec31720bd417 req-799cef79-e703-4e0c-b7d4-9b113040cd85 tempest-TestMinimumBasicScenario-76234117 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-475eed7a-6edc-4eae-aa47-f998043b63fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02f5c685-4cf0-479b-b534-f717da090379', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:17:49 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-2860b03e-2a9c-4387-a918-ec31720bd417 req-799cef79-e703-4e0c-b7d4-9b113040cd85 tempest-TestMinimumBasicScenario-76234117 None] attachment_update completed successfully. Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=37,cinder:SELECT=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=17,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (d9e09260-d421-4c3d-8ba8-cbbdab3acbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e1243d-3c28-4122-a70a-74e7d86cefc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e1243d-3c28-4122-a70a-74e7d86cefc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-773766064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f148d4a-7672-47e2-bff9-e0b0ac82b691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:00Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62c144f-e0c7-47a5-a269-7e67d899a326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62c144f-e0c7-47a5-a269-7e67d899a326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3412cc94-663a-4694-93ad-c0f071afcc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3412cc94-663a-4694-93ad-c0f071afcc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f148d4a-7672-47e2-bff9-e0b0ac82b691', 'volume_name': 'volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55caf99b-77b1-47dc-b999-d3085e2f0419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55caf99b-77b1-47dc-b999-d3085e2f0419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ddf022a-1ae1-4145-8917-d33a136b7eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:17:59 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume 8f148d4a-7672-47e2-bff9-e0b0ac82b691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691', 'volume_size': 1} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-773766064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f148d4a-7672-47e2-bff9-e0b0ac82b691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:00Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Creating volume 8f148d4a-7672-47e2-bff9-e0b0ac82b691 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:17:59 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:17:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:17:59 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 1073741824 Jul 09 03:17:59 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:00 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 1073741824" returned: 0 in 1.043s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:00 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 Jul 09 03:18:00 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:01 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691" returned: 0 in 0.793s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:18:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ddf022a-1ae1-4145-8917-d33a136b7eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e14d2b1-1680-4a79-93f8-f24d0e1a35c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:01 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 (8f148d4a-7672-47e2-bff9-e0b0ac82b691): created successfully Jul 09 03:18:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e14d2b1-1680-4a79-93f8-f24d0e1a35c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (d9e09260-d421-4c3d-8ba8-cbbdab3acbc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1a7866a9-c3c4-4b06-a69f-ec97e8b6191e tempest-CreateVolumesFromSnapshotTest-862499127 None] Created volume successfully. Jul 09 03:18:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] Creating offline snapshot eaa78f3f-de06-424b-8aa0-02fe8bacec54 of volume 8f148d4a-7672-47e2-bff9-e0b0ac82b691 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:18:03 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7a6213-1f47-42a7-8550-dcbc94f76f9c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:03 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 Jul 09 03:18:03 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:03 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691" returned: 0 in 0.840s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:03 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 1G Jul 09 03:18:03 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:04 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 1G" returned: 0 in 0.900s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:04 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 Jul 09 03:18:04 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:05 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54" returned: 0 in 0.763s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:05 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 is being set with open permissions: ugo+rw Jul 09 03:18:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:05 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 Jul 09 03:18:05 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:06 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54" returned: 0 in 0.825s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:06 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.info Jul 09 03:18:06 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:07 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.info" returned: 0 in 0.676s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:07 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.info is being set with open permissions: ugo+rw Jul 09 03:18:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:07 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.info Jul 09 03:18:07 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:07 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.info" returned: 0 in 0.672s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.779s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:07 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d2008f27-61f1-4ba0-b287-940891be765b tempest-CreateVolumesFromSnapshotTest-862499127 None] Create snapshot completed successfully Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (bd0cad4b-bae1-40dc-a754-1291b00892bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b8950e-9997-4513-92d0-4e95826926a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b8950e-9997-4513-92d0-4e95826926a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647129794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7d04c5-bd85-4481-a7aa-d98a7c1f9069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:09Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c224103-48da-4e39-922d-82e53bad5c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c224103-48da-4e39-922d-82e53bad5c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498ce68b-1613-4512-90c5-b66342f1e01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498ce68b-1613-4512-90c5-b66342f1e01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e7d04c5-bd85-4481-a7aa-d98a7c1f9069', 'volume_name': 'volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddee504e-d27d-48dd-b7f4-9a0b8e4ef98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddee504e-d27d-48dd-b7f4-9a0b8e4ef98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49eb42d-77eb-473f-9bd7-1ac5e6326578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:08 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume 2e7d04c5-bd85-4481-a7aa-d98a7c1f9069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069', 'volume_size': 1} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647129794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7d04c5-bd85-4481-a7aa-d98a7c1f9069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:09Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Creating volume 2e7d04c5-bd85-4481-a7aa-d98a7c1f9069 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:18:08 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:18:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:09 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069 1073741824 Jul 09 03:18:09 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (4a3dd2e7-e241-4f1d-ac57-b475b52fc6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a461f00c-9c36-4149-a7aa-3d3aa783425e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a461f00c-9c36-4149-a7aa-3d3aa783425e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659578177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5631477c-1977-434e-8429-ac2b182c0c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:09Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c889cf1c-8071-44d8-826f-d20320af36da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c889cf1c-8071-44d8-826f-d20320af36da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d67baf-8484-467b-b82a-905073d3dac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d67baf-8484-467b-b82a-905073d3dac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5631477c-1977-434e-8429-ac2b182c0c1c', 'volume_name': 'volume-5631477c-1977-434e-8429-ac2b182c0c1c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5efdd2-03c4-4d16-ab91-923ba401f1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5efdd2-03c4-4d16-ab91-923ba401f1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d04332-7cef-4635-bcc0-9ad96aa9fabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:09 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume 5631477c-1977-434e-8429-ac2b182c0c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5631477c-1977-434e-8429-ac2b182c0c1c', 'volume_size': 1} Jul 09 03:18:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (5c6327e1-2fc9-445f-a804-675452ca4d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a213f8e-67fb-4326-9d73-e3b02e14d192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a213f8e-67fb-4326-9d73-e3b02e14d192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2017499414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f14fbb-5e90-4435-a677-30244055f9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:10Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b2750f-f970-4b41-9eb4-cff306543316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b2750f-f970-4b41-9eb4-cff306543316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba41721b-1f37-4eda-a54c-639649540e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba41721b-1f37-4eda-a54c-639649540e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f14fbb-5e90-4435-a677-30244055f9ab', 'volume_name': 'volume-c8f14fbb-5e90-4435-a677-30244055f9ab', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:10 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e80c8f-c34f-47ac-9776-70fbc7f0c5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e80c8f-c34f-47ac-9776-70fbc7f0c5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8453350-8c17-484e-9748-862d114b1d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:10 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume c8f14fbb-5e90-4435-a677-30244055f9ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f14fbb-5e90-4435-a677-30244055f9ab', 'volume_size': 1} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069 1073741824" returned: 0 in 1.398s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:10 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069 Jul 09 03:18:10 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (49e64199-ee36-474f-ab48-8d78f5c556cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb90870-5d46-49f8-b14e-b4813b3ebeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb90870-5d46-49f8-b14e-b4813b3ebeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-326440367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313f87ed-12f6-4932-8fa5-9357f60fb794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:11Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91e7dc7-b371-4d8c-a0d4-ee58479c2764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91e7dc7-b371-4d8c-a0d4-ee58479c2764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5287e4eb-70ce-43af-ab60-0d2935774e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5287e4eb-70ce-43af-ab60-0d2935774e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '313f87ed-12f6-4932-8fa5-9357f60fb794', 'volume_name': 'volume-313f87ed-12f6-4932-8fa5-9357f60fb794', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9114822-03c5-438f-8da1-a934cdd53dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9114822-03c5-438f-8da1-a934cdd53dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0afbc9-031a-4ba9-918d-42a62924a404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:10 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume 313f87ed-12f6-4932-8fa5-9357f60fb794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-313f87ed-12f6-4932-8fa5-9357f60fb794', 'volume_size': 1} Jul 09 03:18:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (ac92ec1c-667e-44a3-948a-edd211cedab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbd94d2-6be7-4198-a635-a2572d2abdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbd94d2-6be7-4198-a635-a2572d2abdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328520153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:11Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab01109-85da-48a8-ab4d-ef85b7758a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab01109-85da-48a8-ab4d-ef85b7758a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f704d577-8e8d-43fd-8a78-8c4cc2573744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f704d577-8e8d-43fd-8a78-8c4cc2573744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3', 'volume_name': 'volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08730b29-b5e7-4944-bf5f-6c658997672c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08730b29-b5e7-4944-bf5f-6c658997672c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b7c83b-7ff6-46c8-9dd6-2256a95e39e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:11 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3', 'volume_size': 1} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:11 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069" returned: 0 in 0.873s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] <== create_volume: return (2362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.364s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.670s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659578177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5631477c-1977-434e-8429-ac2b182c0c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:09Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Creating volume 5631477c-1977-434e-8429-ac2b182c0c1c {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:18:11 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49eb42d-77eb-473f-9bd7-1ac5e6326578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:11 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c 1073741824 Jul 09 03:18:11 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8565c224-09e1-4add-b82d-62f06f1c10c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:11 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069 (2e7d04c5-bd85-4481-a7aa-d98a7c1f9069): created successfully Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8565c224-09e1-4add-b82d-62f06f1c10c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (bd0cad4b-bae1-40dc-a754-1291b00892bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:11 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3a458f95-bf54-443c-9bf0-e3d4bf8c42fd tempest-CreateVolumesFromSnapshotTest-862499127 None] Created volume successfully. Jul 09 03:18:12 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c 1073741824" returned: 0 in 0.891s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:12 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c Jul 09 03:18:12 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:13 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c" returned: 0 in 0.831s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.754s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2017499414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f14fbb-5e90-4435-a677-30244055f9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:10Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Creating volume c8f14fbb-5e90-4435-a677-30244055f9ab {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:18:13 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d04332-7cef-4635-bcc0-9ad96aa9fabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5631477c-1977-434e-8429-ac2b182c0c1c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:13 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab 1073741824 Jul 09 03:18:13 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f3eda3-9de6-41bd-97f0-b9c7b8e5f668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:13 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume volume-5631477c-1977-434e-8429-ac2b182c0c1c (5631477c-1977-434e-8429-ac2b182c0c1c): created successfully Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f3eda3-9de6-41bd-97f0-b9c7b8e5f668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (4a3dd2e7-e241-4f1d-ac57-b475b52fc6c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0d8ea967-ce4c-4ee3-a75a-689cdc693749 tempest-CreateVolumesFromSnapshotTest-862499127 None] Created volume successfully. Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:13 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:18:13 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:14 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab 1073741824" returned: 0 in 1.004s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:14 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab Jul 09 03:18:14 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:14 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.138s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:18:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:18:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:18:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:18:15 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab" returned: 0 in 0.953s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.348s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-326440367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313f87ed-12f6-4932-8fa5-9357f60fb794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:11Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Creating volume 313f87ed-12f6-4932-8fa5-9357f60fb794 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:18:15 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:15 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794 1073741824 Jul 09 03:18:15 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8453350-8c17-484e-9748-862d114b1d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f14fbb-5e90-4435-a677-30244055f9ab', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b7592e-8bf5-4caf-9489-ad3b517e4f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:15 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume volume-c8f14fbb-5e90-4435-a677-30244055f9ab (c8f14fbb-5e90-4435-a677-30244055f9ab): created successfully Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b7592e-8bf5-4caf-9489-ad3b517e4f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (5c6327e1-2fc9-445f-a804-675452ca4d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:15 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-60a1687c-9f83-46c1-a8bd-9c77fe19606b tempest-CreateVolumesFromSnapshotTest-862499127 None] Created volume successfully. Jul 09 03:18:16 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794 1073741824" returned: 0 in 1.189s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:16 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794 Jul 09 03:18:16 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:17 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794" returned: 0 in 0.776s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.887s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328520153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d223a80ed5497c9ed041eb9ba6723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:11Z,use_quota=True,user_id='815edcc7b05f4ff89ebaf5104cb0e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Creating volume c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:18:17 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0afbc9-031a-4ba9-918d-42a62924a404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-313f87ed-12f6-4932-8fa5-9357f60fb794', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624350d8-cab2-47c2-881c-02e06a451be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:17 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3 1073741824 Jul 09 03:18:17 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume volume-313f87ed-12f6-4932-8fa5-9357f60fb794 (313f87ed-12f6-4932-8fa5-9357f60fb794): created successfully Jul 09 03:18:17 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624350d8-cab2-47c2-881c-02e06a451be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (49e64199-ee36-474f-ab48-8d78f5c556cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:17 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4a6682ed-6065-4334-a842-070e430f6cbd tempest-CreateVolumesFromSnapshotTest-862499127 None] Created volume successfully. Jul 09 03:18:18 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3 1073741824" returned: 0 in 1.085s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:18 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3 Jul 09 03:18:18 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:19 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3" returned: 0 in 0.785s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:18:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b7c83b-7ff6-46c8-9dd6-2256a95e39e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dcfb0d-601e-4f8f-8e1c-cc29fcb4a003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:19 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Volume volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3 (c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3): created successfully Jul 09 03:18:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dcfb0d-601e-4f8f-8e1c-cc29fcb4a003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Flow 'volume_create_manager' (ac92ec1c-667e-44a3-948a-edd211cedab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:19 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-236273e5-dfcb-4647-b8a8-1a02d640d1d5 tempest-CreateVolumesFromSnapshotTest-862499127 None] Created volume successfully. Jul 09 03:18:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-quobyte-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3" acquired by "delete_volume" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:20 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc61b9a7-38b0-4ca8-a3c2-20a41ec32655]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:20 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3 Jul 09 03:18:20 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:21 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3" returned: 0 in 1.101s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:21 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3 Jul 09 03:18:21 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:22 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3" returned: 0 in 0.757s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3" released by "delete_volume" :: held 1.927s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Created reservations ['57bae265-be64-4096-b091-f664f427b5c3', '13018264-2d48-43e9-a8fa-f19cd914baaf', '36b30c92-5567-41db-9bd7-f26dfcf1246c', 'fb2cd471-6470-4a64-b7ff-22a4781fe6e0'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:22 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:18:22 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-313f87ed-12f6-4932-8fa5-9357f60fb794-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-313f87ed-12f6-4932-8fa5-9357f60fb794-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-quobyte-313f87ed-12f6-4932-8fa5-9357f60fb794" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-313f87ed-12f6-4932-8fa5-9357f60fb794" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2426c543-7b3b-463b-b3af-e58e6bbff6cf]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:23 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794 Jul 09 03:18:23 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:23 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.848s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:23 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:18:23 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Deleted volume successfully. Jul 09 03:18:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b200abf0-9d37-4b31-86a4-5732f277d829 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-c9c4c77f-97e5-42a4-9fe3-5c75827c3ba3-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:23 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794" returned: 0 in 1.027s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:24 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794 Jul 09 03:18:24 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:24 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-313f87ed-12f6-4932-8fa5-9357f60fb794" returned: 0 in 0.729s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-313f87ed-12f6-4932-8fa5-9357f60fb794" released by "delete_volume" :: held 1.822s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:24 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Created reservations ['e8126a14-cb49-4d0e-948f-01a47cec337a', '9961348b-26e8-4807-b8aa-10342d8fe8c1', 'c805d163-5155-406c-916b-c67772c7d15f', '8deb35e5-468c-46d6-9f5b-5bf08e2d596b'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:18:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:24 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:18:24 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-c8f14fbb-5e90-4435-a677-30244055f9ab-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-c8f14fbb-5e90-4435-a677-30244055f9ab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-quobyte-c8f14fbb-5e90-4435-a677-30244055f9ab" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-c8f14fbb-5e90-4435-a677-30244055f9ab" acquired by "delete_volume" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:25 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0487c7c3-36af-4e0a-944e-79e858131c5b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:25 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab Jul 09 03:18:25 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:25 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.032s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:25 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:18:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Deleted volume successfully. Jul 09 03:18:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f253001e-aebf-4d28-b403-5aeb8a5f94df tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-313f87ed-12f6-4932-8fa5-9357f60fb794-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:26 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab" returned: 0 in 0.962s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:26 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab Jul 09 03:18:26 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:26 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c8f14fbb-5e90-4435-a677-30244055f9ab" returned: 0 in 0.692s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-c8f14fbb-5e90-4435-a677-30244055f9ab" released by "delete_volume" :: held 1.718s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Created reservations ['354eb821-86c0-41ef-ae28-3775c67987fb', 'd17b2bb0-f4bf-4f87-a778-8c2276631875', 'e38f0ac4-3687-4472-a95e-bb4755b64edb', 'd9b63cba-fa6f-4982-845f-d68d4edb85ec'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:27 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:18:27 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-5631477c-1977-434e-8429-ac2b182c0c1c-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-5631477c-1977-434e-8429-ac2b182c0c1c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-quobyte-5631477c-1977-434e-8429-ac2b182c0c1c" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-5631477c-1977-434e-8429-ac2b182c0c1c" acquired by "delete_volume" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[afadec4d-718a-4334-9966-26f41712117a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:27 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c Jul 09 03:18:27 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:28 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.878s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:28 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:18:28 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Deleted volume successfully. Jul 09 03:18:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-839d585f-ecac-4bf9-94a3-da28b94d0c09 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-c8f14fbb-5e90-4435-a677-30244055f9ab-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:28 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c" returned: 0 in 0.935s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:28 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c Jul 09 03:18:28 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:29 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5631477c-1977-434e-8429-ac2b182c0c1c" returned: 0 in 0.709s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-5631477c-1977-434e-8429-ac2b182c0c1c" released by "delete_volume" :: held 1.706s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Created reservations ['854eb7d8-3481-4772-be69-885f2805aaec', '5c2ba353-dd00-447d-b6cd-b47aa659bc19', '324a629d-8aab-48be-a0b7-a5d05fde27f6', '9abbf1f9-8f59-47a2-b48d-e5f38325b348'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:29 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:18:29 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-quobyte-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3700ea3b-76c5-4c2b-bfd2-f6de5b284c26]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:30 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069 Jul 09 03:18:30 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:30 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.744s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:30 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:18:30 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Deleted volume successfully. Jul 09 03:18:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-254d479f-242c-4f04-aa66-597b0d4c6cdb tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-5631477c-1977-434e-8429-ac2b182c0c1c-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:30 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069" returned: 0 in 0.785s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:30 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069 Jul 09 03:18:30 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:31 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069" returned: 0 in 0.690s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069" released by "delete_volume" :: held 1.517s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:31 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Created reservations ['38074280-308d-4c07-b4e6-e83914738421', '66916a32-9fd1-4fb5-a1cf-6e8795695218', '001e26d8-4bd9-4e8e-b810-d2de393a6c55', '0a9dbcfa-7d11-4609-a612-42efa75bd8e8'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:18:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:31 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:18:31 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-eaa78f3f-de06-424b-8aa0-02fe8bacec54-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-eaa78f3f-de06-424b-8aa0-02fe8bacec54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-quobyte-8f148d4a-7672-47e2-bff9-e0b0ac82b691" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-8f148d4a-7672-47e2-bff9-e0b0ac82b691" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-quobyte-eaa78f3f-de06-424b-8aa0-02fe8bacec54" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-eaa78f3f-de06-424b-8aa0-02fe8bacec54" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Deleting offline snapshot eaa78f3f-de06-424b-8aa0-02fe8bacec54 of volume 8f148d4a-7672-47e2-bff9-e0b0ac82b691 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] snapshot_file for this snap is: volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef50a5f-98a3-430c-9ed4-939e66b4fde7]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:32 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.684s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:18:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Deleted volume successfully. Jul 09 03:18:32 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 Jul 09 03:18:32 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1fb05d06-8332-4270-b64a-9a4a9c5ae886 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-2e7d04c5-bd85-4481-a7aa-d98a7c1f9069-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:32 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54" returned: 0 in 0.761s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:18:33 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfba5ee-bafb-407e-a66e-ab9f2bbbe3df]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:33 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 Jul 09 03:18:33 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:33 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691" returned: 0 in 0.861s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:33 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 Jul 09 03:18:33 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:34 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54" returned: 0 in 0.821s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:34 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54 Jul 09 03:18:34 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:35 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691.eaa78f3f-de06-424b-8aa0-02fe8bacec54" returned: 0 in 0.724s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-eaa78f3f-de06-424b-8aa0-02fe8bacec54" released by "_delete_snapshot" :: held 3.305s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-8f148d4a-7672-47e2-bff9-e0b0ac82b691" released by "delete_snapshot" :: held 3.332s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:35 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Created reservations ['ec60d03e-b68f-4335-b7e0-c0893771d0b0', '82d51db5-74ab-454c-98ad-a7fa45f0e4bf', '3909c137-7786-4629-b213-ab6a1ed06465', '4add3e37-0da5-411c-9be6-462dc3c5b5ee'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:18:35 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Delete snapshot completed successfully. Jul 09 03:18:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-78a0cfb8-068c-4706-91d1-33abad8596ca tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-eaa78f3f-de06-424b-8aa0-02fe8bacec54-delete_snapshot" released by "delete_snapshot" :: held 3.495s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-8f148d4a-7672-47e2-bff9-e0b0ac82b691-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-8f148d4a-7672-47e2-bff9-e0b0ac82b691-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "cinder-quobyte-8f148d4a-7672-47e2-bff9-e0b0ac82b691" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-8f148d4a-7672-47e2-bff9-e0b0ac82b691" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:36 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ec134d-f5f0-4bca-aad5-3b9bba928c7f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:36 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 Jul 09 03:18:36 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:37 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691" returned: 0 in 0.790s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:37 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691 Jul 09 03:18:37 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:37 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f148d4a-7672-47e2-bff9-e0b0ac82b691" returned: 0 in 0.655s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-quobyte-8f148d4a-7672-47e2-bff9-e0b0ac82b691" released by "delete_volume" :: held 1.507s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:37 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Created reservations ['a928355d-267d-4262-bad7-1c5d6943bedf', '42af6b05-abc8-4d4b-956d-c65a7a68555d', '46127166-c887-4ff9-9d37-0548295756d6', '020a69ce-7101-48a0-b928-d9900d4cffbb'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:18:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:38 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:18:38 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:38 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.960s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:39 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:18:39 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Deleted volume successfully. Jul 09 03:18:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d374c57b-e8a9-44bf-8148-560c08929a82 tempest-CreateVolumesFromSnapshotTest-862499127 None] Lock "cinder-8f148d4a-7672-47e2-bff9-e0b0ac82b691-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Flow 'volume_create_manager' (f74a09e7-92ba-47c1-8bcd-635079d37bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcbbfd6-6556-4420-8843-0663118d779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcbbfd6-6556-4420-8843-0663118d779b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1008850127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaec3003-0f8d-48eb-972f-2f75d58fa4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b99abe8b54184a289f8dcf077e461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:43Z,use_quota=True,user_id='ec42a1c957da4c6d844946f7905e92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9cbb1ce-5e6a-4a2a-a0db-251be7f11f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9cbb1ce-5e6a-4a2a-a0db-251be7f11f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0758f3-a50a-43ba-806a-c713d39d6a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0758f3-a50a-43ba-806a-c713d39d6a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaec3003-0f8d-48eb-972f-2f75d58fa4e9', 'volume_name': 'volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e304c97-2dec-41af-879d-35d281d950c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e304c97-2dec-41af-879d-35d281d950c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f125da-4e27-4c52-a7f5-0ec2c0b3fd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:42 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Volume aaec3003-0f8d-48eb-972f-2f75d58fa4e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9', 'volume_size': 1} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1008850127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaec3003-0f8d-48eb-972f-2f75d58fa4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b99abe8b54184a289f8dcf077e461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:43Z,use_quota=True,user_id='ec42a1c957da4c6d844946f7905e92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Creating volume aaec3003-0f8d-48eb-972f-2f75d58fa4e9 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:18:42 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:18:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:42 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 1073741824 Jul 09 03:18:42 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:44 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-02bf8d96-e468-4d84-b7dc-5105226fe265 req-8cd11e2c-bc8e-4b13-a5ce-458c9545d3aa tempest-TestMinimumBasicScenario-76234117 None] Terminate volume connection completed successfully. Jul 09 03:18:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-02bf8d96-e468-4d84-b7dc-5105226fe265 req-8cd11e2c-bc8e-4b13-a5ce-458c9545d3aa tempest-TestMinimumBasicScenario-76234117 None] Deleting attachment 02f5c685-4cf0-479b-b534-f717da090379. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:18:44 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 1073741824" returned: 0 in 1.228s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:44 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 Jul 09 03:18:44 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:44 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" returned: 0 in 0.802s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:18:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f125da-4e27-4c52-a7f5-0ec2c0b3fd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c3fc76-eb2b-439f-bb3c-7c9f78fe6396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:45 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Volume volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 (aaec3003-0f8d-48eb-972f-2f75d58fa4e9): created successfully Jul 09 03:18:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c3fc76-eb2b-439f-bb3c-7c9f78fe6396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Flow 'volume_create_manager' (f74a09e7-92ba-47c1-8bcd-635079d37bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-53675df6-bff9-41e4-ba36-6b6ec42ae808 tempest-VolumeDependencyTests-1247435180 None] Created volume successfully. Jul 09 03:18:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Acquiring lock "cinder-475eed7a-6edc-4eae-aa47-f998043b63fb-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Lock "cinder-475eed7a-6edc-4eae-aa47-f998043b63fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Acquiring lock "cinder-quobyte-475eed7a-6edc-4eae-aa47-f998043b63fb" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Lock "cinder-quobyte-475eed7a-6edc-4eae-aa47-f998043b63fb" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:45 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98302b62-f67d-4dfd-8fe5-f6f90330fd04]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:45 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb Jul 09 03:18:45 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] Creating offline snapshot 19fc74ab-2e57-492e-b0e9-126b6a2d926a of volume aaec3003-0f8d-48eb-972f-2f75d58fa4e9 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:18:46 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8516e2ce-07d0-4c85-be66-3b746cd7352e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:46 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 Jul 09 03:18:46 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:46 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb" returned: 0 in 0.868s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:46 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb Jul 09 03:18:46 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:46 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" returned: 0 in 0.840s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:47 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a 1G Jul 09 03:18:47 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:47 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-475eed7a-6edc-4eae-aa47-f998043b63fb" returned: 0 in 0.671s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Lock "cinder-quobyte-475eed7a-6edc-4eae-aa47-f998043b63fb" released by "delete_volume" :: held 1.596s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:47 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Created reservations ['06b7ba69-759e-419f-9408-570754ac9ecb', '924824e8-b64d-45f1-a21e-f4dc3bc01aff', '7b611815-ea77-4655-a0a8-d7baef41a391', '29e63ff6-fd19-43ca-af0e-9975641a0cb3'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:18:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:47 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:18:47 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:47 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a 1G" returned: 0 in 0.805s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:47 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a Jul 09 03:18:47 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:48 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.764s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:48 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:18:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Deleted volume successfully. Jul 09 03:18:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-79c75943-b3e3-4a35-be94-a9d63be10441 tempest-TestMinimumBasicScenario-76234117 None] Lock "cinder-475eed7a-6edc-4eae-aa47-f998043b63fb-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:18:48 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a" returned: 0 in 0.730s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:48 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a is being set with open permissions: ugo+rw Jul 09 03:18:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:48 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a Jul 09 03:18:48 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:49 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a" returned: 0 in 0.674s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:49 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.info Jul 09 03:18:49 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:50 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.info" returned: 0 in 0.890s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:50 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.info is being set with open permissions: ugo+rw Jul 09 03:18:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:50 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.info Jul 09 03:18:50 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:50 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.info" returned: 0 in 0.811s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.851s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-39bfa176-1207-4eef-9eeb-a12d5e6a2e49 tempest-VolumeDependencyTests-1247435180 None] Create snapshot completed successfully Jul 09 03:18:51 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:18:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Flow 'volume_create_manager' (53a6b435-95a7-4681-a3d4-744f7e7edc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:18:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fc574a-3349-4e23-9876-aaf4fa7278c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fc574a-3349-4e23-9876-aaf4fa7278c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-871553188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b99abe8b54184a289f8dcf077e461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=19fc74ab-2e57-492e-b0e9-126b6a2d926a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:18:52Z,use_quota=True,user_id='ec42a1c957da4c6d844946f7905e92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e89d706-80f8-4dfb-adef-abd823d75bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e89d706-80f8-4dfb-adef-abd823d75bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a596d465-153a-4521-b202-91425475a37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a596d465-153a-4521-b202-91425475a37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1', 'volume_name': 'volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1', 'volume_size': 1, 'snapshot_id': '19fc74ab-2e57-492e-b0e9-126b6a2d926a'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4b8336-983c-4723-9a8e-27a9c3b19615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4b8336-983c-4723-9a8e-27a9c3b19615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078a0ec9-1462-4367-a8c7-28e768b1c577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:18:52 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Volume cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1', 'volume_size': 1, 'snapshot_id': '19fc74ab-2e57-492e-b0e9-126b6a2d926a'} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "cinder-quobyte-19fc74ab-2e57-492e-b0e9-126b6a2d926a-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" by "_create_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-19fc74ab-2e57-492e-b0e9-126b6a2d926a-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Creating volume cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 from snapshot 19fc74ab-2e57-492e-b0e9-126b6a2d926a {{(pid=87216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "cinder-quobyte-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] snapshot: 19fc74ab-2e57-492e-b0e9-126b6a2d926a, volume: cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f9f2a2-6ac9-42a6-9bc0-027afaeb0dbe]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:52 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a Jul 09 03:18:52 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:53 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a" returned: 0 in 0.868s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:18:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:18:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:18:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3947fc-ea2a-4f89-aabe-0cf64e1b518c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:53 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 Jul 09 03:18:53 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:53 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" returned: 0 in 0.875s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:53 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:18:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:53 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 Jul 09 03:18:53 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:18:59 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 09 03:18:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" returned: 0 in 5.552s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:18:59 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f1f47b-089e-4595-aebd-bc7b5a208994]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:18:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:18:59 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 Jul 09 03:18:59 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:00 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" returned: 0 in 1.086s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:00 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:19:00 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Converted 1024.00 MB image at 184.39 MB/s Jul 09 03:19:00 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 is being set with open permissions: ugo+rw Jul 09 03:19:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:00 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 Jul 09 03:19:00 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:01 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" returned: 0 in 0.814s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" released by "_copy_volume_from_snapshot" :: held 9.304s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-19fc74ab-2e57-492e-b0e9-126b6a2d926a-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" released by "_create_volume_from_snapshot" :: held 9.338s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.354s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:01 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=63,cinder:UPDATE=87,cinder:DELETE=9,cinder:INSERT=17 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:19:01 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=68,cinder:INSERT=24,cinder:UPDATE=87,cinder:DELETE=7 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:19:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078a0ec9-1462-4367-a8c7-28e768b1c577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1', 'volume_size': 1, 'snapshot_id': '19fc74ab-2e57-492e-b0e9-126b6a2d926a'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7170393b-4d31-4c77-ad8b-437da7f11f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:01 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Volume volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 (cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1): created successfully Jul 09 03:19:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7170393b-4d31-4c77-ad8b-437da7f11f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Flow 'volume_create_manager' (53a6b435-95a7-4681-a3d4-744f7e7edc7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a4c5bcec-9589-4605-ac6b-524e26425b35 tempest-VolumeDependencyTests-1247435180 None] Created volume successfully. Jul 09 03:19:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "cinder-19fc74ab-2e57-492e-b0e9-126b6a2d926a-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-19fc74ab-2e57-492e-b0e9-126b6a2d926a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "cinder-quobyte-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "cinder-quobyte-19fc74ab-2e57-492e-b0e9-126b6a2d926a" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-19fc74ab-2e57-492e-b0e9-126b6a2d926a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Deleting offline snapshot 19fc74ab-2e57-492e-b0e9-126b6a2d926a of volume aaec3003-0f8d-48eb-972f-2f75d58fa4e9 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:19:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] snapshot_file for this snap is: volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:19:02 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75d49f5-daca-4e49-b8ca-d239f47dfb5c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:02 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a Jul 09 03:19:02 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:03 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a" returned: 0 in 0.874s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:19:03 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c614d88-d8dd-4f98-b8e9-a965420e6b5b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:03 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 Jul 09 03:19:03 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:03 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" returned: 0 in 0.810s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:03 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a Jul 09 03:19:03 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:04 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a" returned: 0 in 0.806s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:04 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a Jul 09 03:19:04 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Flow 'volume_create_manager' (603dd513-372f-434d-9e03-e40cc4b2ec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d008396-4a3e-4269-81cd-73da7d40d945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d008396-4a3e-4269-81cd-73da7d40d945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1145470295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f695bc3-5e96-4d11-8ef4-25e900afff5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ba7edf87c444faa863ed6c03827662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:05Z,use_quota=True,user_id='6e7960c4a8e14e8b863356db52b3a2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526143a6-965b-44df-aa03-dcdee1205241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526143a6-965b-44df-aa03-dcdee1205241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fb7862-99ca-4b4b-bba0-c2b721420169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fb7862-99ca-4b4b-bba0-c2b721420169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f695bc3-5e96-4d11-8ef4-25e900afff5e', 'volume_name': 'volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760282b3-42d3-4ed4-a814-00c297ff5521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760282b3-42d3-4ed4-a814-00c297ff5521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d65df1c-6cd9-4212-ad44-e14666949f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:05 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Volume 4f695bc3-5e96-4d11-8ef4-25e900afff5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e', 'volume_size': 1} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1145470295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f695bc3-5e96-4d11-8ef4-25e900afff5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ba7edf87c444faa863ed6c03827662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:05Z,use_quota=True,user_id='6e7960c4a8e14e8b863356db52b3a2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Creating volume 4f695bc3-5e96-4d11-8ef4-25e900afff5e {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:05 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:05 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e 1073741824 Jul 09 03:19:05 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:05 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9.19fc74ab-2e57-492e-b0e9-126b6a2d926a" returned: 0 in 0.852s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-19fc74ab-2e57-492e-b0e9-126b6a2d926a" released by "_delete_snapshot" :: held 3.465s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" released by "delete_snapshot" :: held 3.489s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Created reservations ['61dd6836-306a-4ee9-9428-ae24dc761912', 'ad05f4f3-8fdd-475a-a3c5-053003eaa8f0', '87b022ee-8819-4cc0-ae64-4daeb2034e2d', '85545035-083c-406b-9b1c-eb6d2324bf62'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:05 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Delete snapshot completed successfully. Jul 09 03:19:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b6272bb8-8683-47a6-84eb-56bdac600779 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-19fc74ab-2e57-492e-b0e9-126b6a2d926a-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "cinder-aaec3003-0f8d-48eb-972f-2f75d58fa4e9-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-aaec3003-0f8d-48eb-972f-2f75d58fa4e9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:06 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "cinder-quobyte-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e 1073741824" returned: 0 in 0.975s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:06 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4762b72f-b60a-46fa-b8ec-5fe8d1e61205]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:06 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e Jul 09 03:19:06 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:06 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 Jul 09 03:19:06 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:07 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e" returned: 0 in 0.706s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d65df1c-6cd9-4212-ad44-e14666949f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a00b50e-4b51-4286-ae38-762fc05f7e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:07 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Volume volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e (4f695bc3-5e96-4d11-8ef4-25e900afff5e): created successfully Jul 09 03:19:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a00b50e-4b51-4286-ae38-762fc05f7e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Flow 'volume_create_manager' (603dd513-372f-434d-9e03-e40cc4b2ec84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:07 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-45f33db3-6a23-4f5c-96f5-fea7124cd0ad tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Created volume successfully. Jul 09 03:19:07 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" returned: 0 in 0.899s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:07 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9 Jul 09 03:19:07 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:08 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" returned: 0 in 0.721s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-aaec3003-0f8d-48eb-972f-2f75d58fa4e9" released by "delete_volume" :: held 1.707s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Created reservations ['eb526554-5961-4b26-8065-efe3a6455be2', '7122a95c-6f5b-49df-bfe1-3ffd2a0a2257', '9b290086-34f4-4cad-a057-6f375fd26af4', '3f4452ae-bcd3-4abe-a9eb-3c87fbe7090f'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:08 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:08 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "cinder-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "cinder-quobyte-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c007e09-84c5-4dcf-bcf2-ceb3099d6a88]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:08 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 Jul 09 03:19:08 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:09 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.687s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:09 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Deleted volume successfully. Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-744f69ab-4721-4b48-aeb4-4c5d5073dc45 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-aaec3003-0f8d-48eb-972f-2f75d58fa4e9-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:09 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" returned: 0 in 0.809s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:09 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1 Jul 09 03:19:09 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Flow 'volume_create_manager' (5fe4b94e-762a-487b-9b34-a5c326b969e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c4709c-a5d1-403f-a9ef-dc7d6397c67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c4709c-a5d1-403f-a9ef-dc7d6397c67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-251778067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0864de46-76d2-4ba6-8705-143b9f0e2c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe1309f56834930ba2525576dd7393c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:10Z,use_quota=True,user_id='8cf5ad2866f3492fa776ba2caa3ad1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a5b4eb-e87a-4954-9ae6-2a6728c308c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a5b4eb-e87a-4954-9ae6-2a6728c308c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70c899b-0896-4a0b-a6a1-826dc885dd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70c899b-0896-4a0b-a6a1-826dc885dd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0864de46-76d2-4ba6-8705-143b9f0e2c0f', 'volume_name': 'volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edbb46e-0145-4816-975d-a94a16ef4343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edbb46e-0145-4816-975d-a94a16ef4343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a3a6dc-8d43-4ac9-aa3f-2b60e97128df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:09 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Volume 0864de46-76d2-4ba6-8705-143b9f0e2c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f', 'volume_size': 1} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-251778067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0864de46-76d2-4ba6-8705-143b9f0e2c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe1309f56834930ba2525576dd7393c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:10Z,use_quota=True,user_id='8cf5ad2866f3492fa776ba2caa3ad1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Creating volume 0864de46-76d2-4ba6-8705-143b9f0e2c0f {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:09 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:09 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f 1073741824 Jul 09 03:19:09 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Flow 'volume_create_manager' (d4371ac8-0fdc-4c56-9e0c-0dd04accb1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e05f0b-2430-4374-a405-24600b9e2c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e05f0b-2430-4374-a405-24600b9e2c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-202853244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23644c14-8f29-463a-9db1-5ac3a307ed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe1309f56834930ba2525576dd7393c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:10Z,use_quota=True,user_id='8cf5ad2866f3492fa776ba2caa3ad1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfaa6d5-a9f5-4410-8ea4-b86d85913a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfaa6d5-a9f5-4410-8ea4-b86d85913a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d4ae88-11f7-43e9-9f85-705fabbc80a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d4ae88-11f7-43e9-9f85-705fabbc80a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23644c14-8f29-463a-9db1-5ac3a307ed92', 'volume_name': 'volume-23644c14-8f29-463a-9db1-5ac3a307ed92', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c72ed93-4321-431a-b2f8-ba048afa3726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c72ed93-4321-431a-b2f8-ba048afa3726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f38d5df-31eb-4945-a7d0-367c35ad5036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:10 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Volume 23644c14-8f29-463a-9db1-5ac3a307ed92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23644c14-8f29-463a-9db1-5ac3a307ed92', 'volume_size': 1} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:10 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" returned: 0 in 1.098s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Flow 'volume_create_manager' (ff7c6518-daa0-4987-af2c-3febb3621bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc20937-3dad-41bb-b6f1-dbd817229169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-quobyte-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1" released by "delete_volume" :: held 2.026s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc20937-3dad-41bb-b6f1-dbd817229169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-143021595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f816584a-7c3f-4fef-9655-b46576977319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe1309f56834930ba2525576dd7393c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:11Z,use_quota=True,user_id='8cf5ad2866f3492fa776ba2caa3ad1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eeaecb-91cd-4cd5-ab07-75666293a9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eeaecb-91cd-4cd5-ab07-75666293a9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef808b39-603c-4275-80af-79a7143ff89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef808b39-603c-4275-80af-79a7143ff89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f816584a-7c3f-4fef-9655-b46576977319', 'volume_name': 'volume-f816584a-7c3f-4fef-9655-b46576977319', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caeb5b5-6fd9-4b2d-9eab-e5d2eb8a7873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caeb5b5-6fd9-4b2d-9eab-e5d2eb8a7873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c2c098-4528-46b5-a907-53edd2a09a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:10 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Volume f816584a-7c3f-4fef-9655-b46576977319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f816584a-7c3f-4fef-9655-b46576977319', 'volume_size': 1} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-937488dc-cefe-4a6c-8eb8-f64d955cbfdc req-bf0d7701-061b-4005-8309-6a6f14b089ed tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:10 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Created reservations ['5a6f8c0c-1646-4e2e-9052-194b5e8a6654', 'a0c1797f-a69c-4726-a2f3-9bff5977eefc', '6bea638f-9f96-40c4-a0ef-7439fc33689a', '1e7a5b89-5ff4-495e-af96-aa9e4dd357b9'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:11 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:11 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:11 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Flow 'volume_create_manager' (83581ac6-a388-46d8-be6d-702be2208e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f3b665-a287-4c18-9189-29c1e7e04985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f 1073741824" returned: 0 in 1.402s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f3b665-a287-4c18-9189-29c1e7e04985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1913435346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48e2eca-5b70-4d8b-ac69-7af695257c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe1309f56834930ba2525576dd7393c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:11Z,use_quota=True,user_id='8cf5ad2866f3492fa776ba2caa3ad1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96cb6de7-2d51-494c-b06a-041b259f328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96cb6de7-2d51-494c-b06a-041b259f328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b35312-9a73-40ce-8d82-fda86484667b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b35312-9a73-40ce-8d82-fda86484667b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f48e2eca-5b70-4d8b-ac69-7af695257c16', 'volume_name': 'volume-f48e2eca-5b70-4d8b-ac69-7af695257c16', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664935a1-ca2f-4df1-8abe-c52244d685f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664935a1-ca2f-4df1-8abe-c52244d685f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4a4ddc-fd5e-41b5-ad8f-a58abc5496f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:11 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Volume f48e2eca-5b70-4d8b-ac69-7af695257c16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f48e2eca-5b70-4d8b-ac69-7af695257c16', 'volume_size': 1} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:11 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f Jul 09 03:19:11 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Flow 'volume_create_manager' (199ff488-8edb-4bb3-a877-c0b7222e8af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16622b36-f8bb-424f-8d3a-e542164aef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16622b36-f8bb-424f-8d3a-e542164aef89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-923845149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aac29c7-9e74-4792-b96b-3ef96dcd2d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe1309f56834930ba2525576dd7393c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:12Z,use_quota=True,user_id='8cf5ad2866f3492fa776ba2caa3ad1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cc2e9f-69ac-4b98-aa5d-87d75b9c158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cc2e9f-69ac-4b98-aa5d-87d75b9c158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca4b810-1873-4839-9679-3e293dca8f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca4b810-1873-4839-9679-3e293dca8f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aac29c7-9e74-4792-b96b-3ef96dcd2d1e', 'volume_name': 'volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f1c472-fda6-4019-81b6-dccaf5d8753b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f1c472-fda6-4019-81b6-dccaf5d8753b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e562d8-df30-47de-9351-82541aeb73e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:11 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Volume 5aac29c7-9e74-4792-b96b-3ef96dcd2d1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e', 'volume_size': 1} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:11 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.711s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:11 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Deleted volume successfully. Jul 09 03:19:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5711e3d-c522-4609-a4e4-a23312463336 tempest-VolumeDependencyTests-1247435180 None] Lock "cinder-cc55a2e6-3a02-4b2a-897e-0eb2a69ceea1-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:12 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f" returned: 0 in 0.707s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.684s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-202853244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23644c14-8f29-463a-9db1-5ac3a307ed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe1309f56834930ba2525576dd7393c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:10Z,use_quota=True,user_id='8cf5ad2866f3492fa776ba2caa3ad1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Creating volume 23644c14-8f29-463a-9db1-5ac3a307ed92 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:12 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:12 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92 1073741824 Jul 09 03:19:12 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a3a6dc-8d43-4ac9-aa3f-2b60e97128df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3388224f-a25e-4177-8d8a-f753394a485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:12 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Volume volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f (0864de46-76d2-4ba6-8705-143b9f0e2c0f): created successfully Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3388224f-a25e-4177-8d8a-f753394a485a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Flow 'volume_create_manager' (5fe4b94e-762a-487b-9b34-a5c326b969e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:12 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-86dcf28d-41a2-4176-91fd-15a3031f63af tempest-CreateVolumesFromImageTest-839653733 None] Created volume successfully. Jul 09 03:19:12 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92 1073741824" returned: 0 in 0.893s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:12 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92 Jul 09 03:19:12 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:13 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92" returned: 0 in 0.698s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.772s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-143021595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f816584a-7c3f-4fef-9655-b46576977319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe1309f56834930ba2525576dd7393c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:11Z,use_quota=True,user_id='8cf5ad2866f3492fa776ba2caa3ad1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Creating volume f816584a-7c3f-4fef-9655-b46576977319 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:13 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:13 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319 1073741824 Jul 09 03:19:13 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f38d5df-31eb-4945-a7d0-367c35ad5036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23644c14-8f29-463a-9db1-5ac3a307ed92', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3406b1a-c01b-4f98-bad2-44e0803895e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:13 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Volume volume-23644c14-8f29-463a-9db1-5ac3a307ed92 (23644c14-8f29-463a-9db1-5ac3a307ed92): created successfully Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3406b1a-c01b-4f98-bad2-44e0803895e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Flow 'volume_create_manager' (d4371ac8-0fdc-4c56-9e0c-0dd04accb1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a67b97de-6c00-4d53-a9fb-b22cdc8252b9 tempest-CreateVolumesFromImageTest-839653733 None] Created volume successfully. Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:13 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:13 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:14 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.672s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:19:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:19:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:19:14 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319 1073741824" returned: 0 in 0.889s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:14 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319 Jul 09 03:19:14 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:15 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319" returned: 0 in 0.698s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-937488dc-cefe-4a6c-8eb8-f64d955cbfdc req-bf0d7701-061b-4005-8309-6a6f14b089ed tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.400s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c2c098-4528-46b5-a907-53edd2a09a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f816584a-7c3f-4fef-9655-b46576977319', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (becdc993-4009-4187-b565-51fad79a22a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb8168f-ca9c-4404-92aa-be9da45e6d06]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-937488dc-cefe-4a6c-8eb8-f64d955cbfdc req-bf0d7701-061b-4005-8309-6a6f14b089ed tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:15 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Volume volume-f816584a-7c3f-4fef-9655-b46576977319 (f816584a-7c3f-4fef-9655-b46576977319): created successfully Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (becdc993-4009-4187-b565-51fad79a22a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Flow 'volume_create_manager' (ff7c6518-daa0-4987-af2c-3febb3621bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:15 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6fbdbe89-62fa-4ba7-919d-7addf340930f tempest-CreateVolumesFromImageTest-839653733 None] Created volume successfully. Jul 09 03:19:15 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e Jul 09 03:19:15 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Flow 'volume_create_manager' (930592fb-70ca-4b6e-ab0b-f8ddce9bf647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b397dc-b816-4bb6-99c8-fb131955d848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b397dc-b816-4bb6-99c8-fb131955d848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579933743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36262a93-be30-445b-bbd0-892f8d103026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aafc22083c45ee83442b1e48a43192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:16Z,use_quota=True,user_id='2712afb09e7142969ddff7f90ca71e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11073d6-ba4b-470b-a190-819b2b6b097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11073d6-ba4b-470b-a190-819b2b6b097e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4e737d-4907-40c4-9f32-42f93865e1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4e737d-4907-40c4-9f32-42f93865e1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36262a93-be30-445b-bbd0-892f8d103026', 'volume_name': 'volume-36262a93-be30-445b-bbd0-892f8d103026', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc45bcd-f112-444c-9e6a-47510dcfdf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc45bcd-f112-444c-9e6a-47510dcfdf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb56ebf-11d7-4995-905a-71468a4f6588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:15 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Volume 36262a93-be30-445b-bbd0-892f8d103026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36262a93-be30-445b-bbd0-892f8d103026', 'volume_size': 1} Jul 09 03:19:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:16 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-937488dc-cefe-4a6c-8eb8-f64d955cbfdc req-bf0d7701-061b-4005-8309-6a6f14b089ed tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e" returned: 0 in 0.808s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-937488dc-cefe-4a6c-8eb8-f64d955cbfdc req-bf0d7701-061b-4005-8309-6a6f14b089ed tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.833s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.862s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1913435346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48e2eca-5b70-4d8b-ac69-7af695257c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe1309f56834930ba2525576dd7393c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:11Z,use_quota=True,user_id='8cf5ad2866f3492fa776ba2caa3ad1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Creating volume f48e2eca-5b70-4d8b-ac69-7af695257c16 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:16 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:16 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16 1073741824 Jul 09 03:19:16 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:16 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-937488dc-cefe-4a6c-8eb8-f64d955cbfdc req-bf0d7701-061b-4005-8309-6a6f14b089ed tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3e0812b-44e3-4d56-821e-ae8ae048f9db', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:19:16 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-937488dc-cefe-4a6c-8eb8-f64d955cbfdc req-bf0d7701-061b-4005-8309-6a6f14b089ed tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] attachment_update completed successfully. Jul 09 03:19:17 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16 1073741824" returned: 0 in 0.906s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:17 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16 Jul 09 03:19:17 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:17 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16" returned: 0 in 0.638s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.078s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-923845149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aac29c7-9e74-4792-b96b-3ef96dcd2d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe1309f56834930ba2525576dd7393c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:12Z,use_quota=True,user_id='8cf5ad2866f3492fa776ba2caa3ad1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Creating volume 5aac29c7-9e74-4792-b96b-3ef96dcd2d1e {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:17 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:17 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e 1073741824 Jul 09 03:19:17 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4a4ddc-fd5e-41b5-ad8f-a58abc5496f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f48e2eca-5b70-4d8b-ac69-7af695257c16', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47f0e0a-9d2e-42df-8bca-f2628cb57ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:17 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Volume volume-f48e2eca-5b70-4d8b-ac69-7af695257c16 (f48e2eca-5b70-4d8b-ac69-7af695257c16): created successfully Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47f0e0a-9d2e-42df-8bca-f2628cb57ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Flow 'volume_create_manager' (83581ac6-a388-46d8-be6d-702be2208e52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:17 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c936128a-de86-4f29-991c-81b1f4b9c765 tempest-CreateVolumesFromImageTest-839653733 None] Created volume successfully. Jul 09 03:19:18 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e 1073741824" returned: 0 in 0.864s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:18 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e Jul 09 03:19:18 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:19 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e" returned: 0 in 0.671s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.403s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579933743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36262a93-be30-445b-bbd0-892f8d103026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aafc22083c45ee83442b1e48a43192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:16Z,use_quota=True,user_id='2712afb09e7142969ddff7f90ca71e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Creating volume 36262a93-be30-445b-bbd0-892f8d103026 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:19 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e562d8-df30-47de-9351-82541aeb73e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa32045-bc67-4c2b-9b75-46dbad8797f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:19 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026 1073741824 Jul 09 03:19:19 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:19 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Volume volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e (5aac29c7-9e74-4792-b96b-3ef96dcd2d1e): created successfully Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa32045-bc67-4c2b-9b75-46dbad8797f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Flow 'volume_create_manager' (199ff488-8edb-4bb3-a877-c0b7222e8af6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:19 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b23d37fb-a902-402c-87cc-b6e6fa29094d tempest-CreateVolumesFromImageTest-839653733 None] Created volume successfully. Jul 09 03:19:20 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026 1073741824" returned: 0 in 0.889s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:20 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026 Jul 09 03:19:20 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "cinder-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "cinder-quobyte-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-quobyte-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:20 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e9837e-304d-47b1-b195-64d83df4ad69]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:20 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e Jul 09 03:19:20 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:20 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026" returned: 0 in 0.722s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb56ebf-11d7-4995-905a-71468a4f6588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36262a93-be30-445b-bbd0-892f8d103026', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a509d5-68f3-4786-9632-6ecd632234d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:21 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Volume volume-36262a93-be30-445b-bbd0-892f8d103026 (36262a93-be30-445b-bbd0-892f8d103026): created successfully Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a509d5-68f3-4786-9632-6ecd632234d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Flow 'volume_create_manager' (930592fb-70ca-4b6e-ab0b-f8ddce9bf647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:21 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1f3dd158-5f70-46ca-a757-aaca06df61e7 tempest-ProjectReaderTests-309445571 None] Created volume successfully. Jul 09 03:19:21 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e" returned: 0 in 0.813s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:21 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e Jul 09 03:19:21 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:21 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e" returned: 0 in 0.630s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-quobyte-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e" released by "delete_volume" :: held 1.501s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Created reservations ['0119e38b-6bdb-4c63-8ecf-d385bf961cbd', 'af0c06c0-78cf-41f9-b16e-03906cf6a03a', '2890541e-6099-4f0f-897f-fd6f897834a6', 'dfad49b5-61e4-4fcf-816d-3637aa435ca1'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:22 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:22 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-c7a5ba27-e06b-4083-a1d8-1f0eb0582881 req-49189278-96e9-4fe0-a3df-5419c3730796 tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Terminate volume connection completed successfully. Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-c7a5ba27-e06b-4083-a1d8-1f0eb0582881 req-49189278-96e9-4fe0-a3df-5419c3730796 tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Deleting attachment f3e0812b-44e3-4d56-821e-ae8ae048f9db. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Acquiring lock "cinder-36262a93-be30-445b-bbd0-892f8d103026-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Lock "cinder-36262a93-be30-445b-bbd0-892f8d103026-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Acquiring lock "cinder-quobyte-36262a93-be30-445b-bbd0-892f8d103026" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Lock "cinder-quobyte-36262a93-be30-445b-bbd0-892f8d103026" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0ea625-f063-4593-b624-48850d30cf64]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "cinder-f48e2eca-5b70-4d8b-ac69-7af695257c16-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-f48e2eca-5b70-4d8b-ac69-7af695257c16-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "cinder-quobyte-f48e2eca-5b70-4d8b-ac69-7af695257c16" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:22 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026 Jul 09 03:19:22 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-quobyte-f48e2eca-5b70-4d8b-ac69-7af695257c16" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ef43d-45e8-437f-bc2e-5775bb80f5f0]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:22 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.738s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Deleted volume successfully. Jul 09 03:19:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee842ca8-5ae4-40db-924f-a90a84ad4dbd tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-5aac29c7-9e74-4792-b96b-3ef96dcd2d1e-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:22 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16 Jul 09 03:19:22 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:23 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026" returned: 0 in 0.831s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:23 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026 Jul 09 03:19:23 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:23 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16" returned: 0 in 0.780s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:23 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16 Jul 09 03:19:23 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:24 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-36262a93-be30-445b-bbd0-892f8d103026" returned: 0 in 0.680s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Lock "cinder-quobyte-36262a93-be30-445b-bbd0-892f8d103026" released by "delete_volume" :: held 1.565s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Created reservations ['5dd57725-0dff-45ee-bf01-0b896abad4e8', '08ada3fc-14b4-433c-992a-083ecbf5f9b3', '0f9d030e-df7b-46b5-996a-fdc6854713bd', '357fdb13-eacb-4711-a41d-807daf8ac568'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:24 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f48e2eca-5b70-4d8b-ac69-7af695257c16" returned: 0 in 0.719s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:24 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:24 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-quobyte-f48e2eca-5b70-4d8b-ac69-7af695257c16" released by "delete_volume" :: held 1.546s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Created reservations ['65ae1835-c7c2-4474-bc39-1674cbdc4d44', 'd8b1f1a5-b19a-478e-8fba-d30b9aea165d', 'd9724cdb-1e41-4bd4-a714-cda41f5378fa', 'e1da989d-41e6-43bc-94ba-1dec2186c07d'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:24 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:24 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Acquiring lock "cinder-4f695bc3-5e96-4d11-8ef4-25e900afff5e-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "cinder-4f695bc3-5e96-4d11-8ef4-25e900afff5e-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Acquiring lock "cinder-quobyte-4f695bc3-5e96-4d11-8ef4-25e900afff5e" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "cinder-quobyte-4f695bc3-5e96-4d11-8ef4-25e900afff5e" acquired by "delete_volume" :: waited 0.032s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:24 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "cinder-f816584a-7c3f-4fef-9655-b46576977319-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4808af2-91bd-42b1-a832-ded627d3c318]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.840s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:25 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Deleted volume successfully. Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-f816584a-7c3f-4fef-9655-b46576977319-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-646a0548-afa3-4f7b-8ddc-978607326c70 tempest-ProjectReaderTests-309445571 None] Lock "cinder-36262a93-be30-445b-bbd0-892f8d103026-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "cinder-quobyte-f816584a-7c3f-4fef-9655-b46576977319" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-quobyte-f816584a-7c3f-4fef-9655-b46576977319" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9c15b6-61b7-43ea-bf31-330808437fd9]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:25 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e Jul 09 03:19:25 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Flow 'volume_create_manager' (a7d9f2bb-9117-4a53-97a4-88c520466b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3622ccb-bd73-4a37-9dec-e5f7b3b4c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:25 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.960s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3622ccb-bd73-4a37-9dec-e5f7b3b4c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1318283620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9fc649-d29c-4700-b37c-8a1881a28952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aafc22083c45ee83442b1e48a43192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:25Z,use_quota=True,user_id='2712afb09e7142969ddff7f90ca71e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69be8e64-fa0e-4aac-b6bb-0589bf530dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69be8e64-fa0e-4aac-b6bb-0589bf530dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44e8380-42cb-48f2-8615-633a709b0335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:25 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319 Jul 09 03:19:25 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44e8380-42cb-48f2-8615-633a709b0335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9fc649-d29c-4700-b37c-8a1881a28952', 'volume_name': 'volume-1b9fc649-d29c-4700-b37c-8a1881a28952', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d98eaf-3315-4dd5-8381-fea9fa525bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d98eaf-3315-4dd5-8381-fea9fa525bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7add90-95bf-400e-9a72-dd944df37b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:25 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Volume 1b9fc649-d29c-4700-b37c-8a1881a28952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9fc649-d29c-4700-b37c-8a1881a28952', 'volume_size': 1} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1318283620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9fc649-d29c-4700-b37c-8a1881a28952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aafc22083c45ee83442b1e48a43192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:25Z,use_quota=True,user_id='2712afb09e7142969ddff7f90ca71e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Creating volume 1b9fc649-d29c-4700-b37c-8a1881a28952 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:25 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:25 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Deleted volume successfully. Jul 09 03:19:25 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952 1073741824 Jul 09 03:19:25 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d5eda23d-ac5c-4bbf-afdf-8993b212369e tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-f48e2eca-5b70-4d8b-ac69-7af695257c16-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:25 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e" returned: 0 in 0.898s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:25 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e Jul 09 03:19:25 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:26 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319" returned: 0 in 0.890s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:26 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319 Jul 09 03:19:26 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:26 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952 1073741824" returned: 0 in 0.925s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:26 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952 Jul 09 03:19:26 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:26 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-4f695bc3-5e96-4d11-8ef4-25e900afff5e" returned: 0 in 0.688s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "cinder-quobyte-4f695bc3-5e96-4d11-8ef4-25e900afff5e" released by "delete_volume" :: held 1.672s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Created reservations ['d9e6389a-0c42-4aa2-817d-88e6e5410628', '44704a8e-98b3-4854-893e-f6f70ff38dd5', '3ea9231a-29ed-4405-97b3-f78f40aa96ef', '6ba87ed0-24b3-4358-aa28-4e579e99ac63'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:26 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f816584a-7c3f-4fef-9655-b46576977319" returned: 0 in 0.692s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:26 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:26 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-quobyte-f816584a-7c3f-4fef-9655-b46576977319" released by "delete_volume" :: held 1.648s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Created reservations ['86e4dde6-1e47-4984-b4c5-0a1323ea597c', '90ff1daa-3399-40f0-bdcb-a098c4cda957', '94a3beb1-b29b-4f00-a7fe-731223cc9745', '2e304dba-6ef4-4abd-b176-3abece831877'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:27 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:27 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:27 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952" returned: 0 in 0.724s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7add90-95bf-400e-9a72-dd944df37b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9fc649-d29c-4700-b37c-8a1881a28952', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17277e44-fa5f-4a8f-9a98-2c17676651f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:27 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Volume volume-1b9fc649-d29c-4700-b37c-8a1881a28952 (1b9fc649-d29c-4700-b37c-8a1881a28952): created successfully Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17277e44-fa5f-4a8f-9a98-2c17676651f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Flow 'volume_create_manager' (a7d9f2bb-9117-4a53-97a4-88c520466b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-79404320-fe25-4f3b-ae41-8913bb061095 tempest-ProjectReaderTests-309445571 None] Created volume successfully. Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Acquiring lock "cinder-1b9fc649-d29c-4700-b37c-8a1881a28952-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "cinder-23644c14-8f29-463a-9db1-5ac3a307ed92-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Lock "cinder-1b9fc649-d29c-4700-b37c-8a1881a28952-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-23644c14-8f29-463a-9db1-5ac3a307ed92-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "cinder-quobyte-23644c14-8f29-463a-9db1-5ac3a307ed92" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Acquiring lock "cinder-quobyte-1b9fc649-d29c-4700-b37c-8a1881a28952" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-quobyte-23644c14-8f29-463a-9db1-5ac3a307ed92" acquired by "delete_volume" :: waited 0.038s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Lock "cinder-quobyte-1b9fc649-d29c-4700-b37c-8a1881a28952" acquired by "delete_volume" :: waited 0.063s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebd27b6-097a-4c90-9357-387d9671e2bd]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0f43be-9adb-4704-901e-a607a540b63d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:27 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.879s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Deleted volume successfully. Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2324a80-7acf-4dbb-ac3d-cf6b9656455f tempest-TestServerVolumeAttachScenarioOldVersion-1105325421 None] Lock "cinder-4f695bc3-5e96-4d11-8ef4-25e900afff5e-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:27 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92 Jul 09 03:19:27 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:27 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952 Jul 09 03:19:27 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:27 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.824s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Deleted volume successfully. Jul 09 03:19:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7db5dbd8-1866-413c-876d-e36eccdfb1c6 tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-f816584a-7c3f-4fef-9655-b46576977319-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:28 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92" returned: 0 in 0.829s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:28 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92 Jul 09 03:19:28 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:28 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952" returned: 0 in 0.872s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:28 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952 Jul 09 03:19:28 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:29 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-23644c14-8f29-463a-9db1-5ac3a307ed92" returned: 0 in 0.778s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-quobyte-23644c14-8f29-463a-9db1-5ac3a307ed92" released by "delete_volume" :: held 1.676s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Created reservations ['fa2795ac-70fe-4099-b873-4f0ce0b0ab96', '723a8809-1a83-4b11-81c9-692b27cccf38', '202ac0c5-5ac3-4f92-8646-127267af78b8', '90e6a4b2-4bd9-40fb-b8e3-230900fce539'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:29 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1b9fc649-d29c-4700-b37c-8a1881a28952" returned: 0 in 0.820s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Lock "cinder-quobyte-1b9fc649-d29c-4700-b37c-8a1881a28952" released by "delete_volume" :: held 1.749s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:29 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:29 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Created reservations ['e51b1522-9f9f-428c-bea2-6e79f865b00a', 'e8d3fccd-153e-4d19-9d73-992ba7887b0f', '3150130d-69a6-4850-a51b-029696a095f0', '6aa44f7a-5fda-49e1-afb6-6e4c317b9b68'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:29 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:29 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "cinder-0864de46-76d2-4ba6-8705-143b9f0e2c0f-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-0864de46-76d2-4ba6-8705-143b9f0e2c0f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "cinder-quobyte-0864de46-76d2-4ba6-8705-143b9f0e2c0f" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-quobyte-0864de46-76d2-4ba6-8705-143b9f0e2c0f" acquired by "delete_volume" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee742368-e0bd-4f64-a26b-5bb68c34eb75]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:30 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f Jul 09 03:19:30 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:30 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.970s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:30 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:30 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Deleted volume successfully. Jul 09 03:19:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bffecaa3-9c23-4bd6-97bb-9cdf93ab4fe2 tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-23644c14-8f29-463a-9db1-5ac3a307ed92-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:30 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.989s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:30 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:30 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Deleted volume successfully. Jul 09 03:19:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-106bc0e8-4ca1-4fc8-a726-b2703a390699 tempest-ProjectReaderTests-309445571 None] Lock "cinder-1b9fc649-d29c-4700-b37c-8a1881a28952-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:30 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f" returned: 0 in 0.998s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:31 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f Jul 09 03:19:31 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:31 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-0864de46-76d2-4ba6-8705-143b9f0e2c0f" returned: 0 in 0.703s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-quobyte-0864de46-76d2-4ba6-8705-143b9f0e2c0f" released by "delete_volume" :: held 1.760s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:31 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Created reservations ['bab68a77-a5a6-440d-8022-97f2bbd07a39', '8b5e833c-db90-402a-b115-405b063e4ccc', '9ab618aa-d15c-4f6e-a08b-7a08c9c582f8', '49db3fa4-3606-4b8d-8dc8-fa1ac6c47db1'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:31 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:31 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:32 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.680s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:32 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Deleted volume successfully. Jul 09 03:19:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-37a8683a-9e3a-467b-9863-9ec58c5b7d4c tempest-CreateVolumesFromImageTest-839653733 None] Lock "cinder-0864de46-76d2-4ba6-8705-143b9f0e2c0f-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Flow 'volume_create_manager' (a2f41e1e-7812-4059-ba1a-a714954493ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62beb93-bc34-4518-b0a8-4a468facb514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62beb93-bc34-4518-b0a8-4a468facb514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34166341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63802912-0cc2-484c-bec8-cb713a4ba3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e2ff28a73b454591b82e951d4fd1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:40Z,use_quota=True,user_id='ff4083c1c27c414ebd7ea6cbb232ad43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78971d08-23bc-44fa-bb7c-6b7dab679f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78971d08-23bc-44fa-bb7c-6b7dab679f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b435a4-600a-4e72-9edf-8dbd57be779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b435a4-600a-4e72-9edf-8dbd57be779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63802912-0cc2-484c-bec8-cb713a4ba3fe', 'volume_name': 'volume-63802912-0cc2-484c-bec8-cb713a4ba3fe', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd01861-7aaf-41bd-9bcf-b35332d07d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd01861-7aaf-41bd-9bcf-b35332d07d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7152be-8129-413a-8ab7-18cc783ad83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:39 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Volume 63802912-0cc2-484c-bec8-cb713a4ba3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63802912-0cc2-484c-bec8-cb713a4ba3fe', 'volume_size': 1} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34166341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63802912-0cc2-484c-bec8-cb713a4ba3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e2ff28a73b454591b82e951d4fd1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:40Z,use_quota=True,user_id='ff4083c1c27c414ebd7ea6cbb232ad43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Creating volume 63802912-0cc2-484c-bec8-cb713a4ba3fe {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:39 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:39 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe 1073741824 Jul 09 03:19:39 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:40 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe 1073741824" returned: 0 in 1.004s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:40 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe Jul 09 03:19:40 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:41 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe" returned: 0 in 0.720s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7152be-8129-413a-8ab7-18cc783ad83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63802912-0cc2-484c-bec8-cb713a4ba3fe', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e027ec-705d-4e29-8e61-49f8fb94a9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:41 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Volume volume-63802912-0cc2-484c-bec8-cb713a4ba3fe (63802912-0cc2-484c-bec8-cb713a4ba3fe): created successfully Jul 09 03:19:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e027ec-705d-4e29-8e61-49f8fb94a9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Flow 'volume_create_manager' (a2f41e1e-7812-4059-ba1a-a714954493ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:41 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9123c90b-0513-43ef-9a20-61d55ee9bb41 tempest-ProjectReaderTests-529347886 None] Created volume successfully. Jul 09 03:19:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Acquiring lock "cinder-63802912-0cc2-484c-bec8-cb713a4ba3fe-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Lock "cinder-63802912-0cc2-484c-bec8-cb713a4ba3fe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Acquiring lock "cinder-quobyte-63802912-0cc2-484c-bec8-cb713a4ba3fe" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Lock "cinder-quobyte-63802912-0cc2-484c-bec8-cb713a4ba3fe" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:42 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea312b7-1be5-4c73-8668-f893cb9188d0]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:42 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe Jul 09 03:19:42 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:42 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe" returned: 0 in 0.817s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:43 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe Jul 09 03:19:43 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:43 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-63802912-0cc2-484c-bec8-cb713a4ba3fe" returned: 0 in 0.797s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Lock "cinder-quobyte-63802912-0cc2-484c-bec8-cb713a4ba3fe" released by "delete_volume" :: held 1.675s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:43 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Created reservations ['d4c41365-a215-4e41-ac12-81d71810836e', 'e01d17b8-42a0-4b6a-9931-1f478a787074', '463fcbf9-c819-4201-8923-8ef76b58a529', '024abfa7-8f45-49fd-a967-4865785f9414'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:44 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:44 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:44 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.725s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:44 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:44 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Deleted volume successfully. Jul 09 03:19:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b1a89ed7-93aa-4406-bd56-62ce00579d3d tempest-ProjectReaderTests-529347886 None] Lock "cinder-63802912-0cc2-484c-bec8-cb713a4ba3fe-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:44 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Flow 'volume_create_manager' (43c64803-d6ae-4268-911f-3ef8f7740547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2047607-aef3-48f2-9234-275b35358e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2047607-aef3-48f2-9234-275b35358e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-142066054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec09f65-9763-4e07-9c2c-e0473ea2c994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e2ff28a73b454591b82e951d4fd1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:45Z,use_quota=True,user_id='ff4083c1c27c414ebd7ea6cbb232ad43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760e20af-b5df-4bc9-8218-e9b88d2e1c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760e20af-b5df-4bc9-8218-e9b88d2e1c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89869e1-60a4-4ed5-a85e-49c6e57bf02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89869e1-60a4-4ed5-a85e-49c6e57bf02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec09f65-9763-4e07-9c2c-e0473ea2c994', 'volume_name': 'volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c44dd56-7a20-4d83-bbe7-8b718d6a8079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c44dd56-7a20-4d83-bbe7-8b718d6a8079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b95036-10ba-4a70-9b73-ae59acfea937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:45 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Volume 7ec09f65-9763-4e07-9c2c-e0473ea2c994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994', 'volume_size': 1} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-142066054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec09f65-9763-4e07-9c2c-e0473ea2c994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e2ff28a73b454591b82e951d4fd1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:45Z,use_quota=True,user_id='ff4083c1c27c414ebd7ea6cbb232ad43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Creating volume 7ec09f65-9763-4e07-9c2c-e0473ea2c994 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:45 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:45 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994 1073741824 Jul 09 03:19:45 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:46 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994 1073741824" returned: 0 in 1.073s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:46 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994 Jul 09 03:19:46 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:47 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994" returned: 0 in 0.762s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b95036-10ba-4a70-9b73-ae59acfea937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd08ad3-4841-4c76-8b0f-bf74e235cd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:47 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Volume volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994 (7ec09f65-9763-4e07-9c2c-e0473ea2c994): created successfully Jul 09 03:19:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd08ad3-4841-4c76-8b0f-bf74e235cd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Flow 'volume_create_manager' (43c64803-d6ae-4268-911f-3ef8f7740547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:47 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-07c89681-0676-4615-a85e-7fd024aa8528 tempest-ProjectReaderTests-529347886 None] Created volume successfully. Jul 09 03:19:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Acquiring lock "cinder-7ec09f65-9763-4e07-9c2c-e0473ea2c994-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Lock "cinder-7ec09f65-9763-4e07-9c2c-e0473ea2c994-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Acquiring lock "cinder-quobyte-7ec09f65-9763-4e07-9c2c-e0473ea2c994" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Lock "cinder-quobyte-7ec09f65-9763-4e07-9c2c-e0473ea2c994" acquired by "delete_volume" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:48 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba3e0b5-2c7a-41e4-ad1f-e7cfa6d7386e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:48 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994 Jul 09 03:19:48 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:49 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994" returned: 0 in 0.973s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:49 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994 Jul 09 03:19:49 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:50 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7ec09f65-9763-4e07-9c2c-e0473ea2c994" returned: 0 in 0.748s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:50 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Lock "cinder-quobyte-7ec09f65-9763-4e07-9c2c-e0473ea2c994" released by "delete_volume" :: held 1.778s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:50 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Created reservations ['b878dd4c-acb9-45a7-8f79-30b0b8f6a46a', '8229d513-4d6a-4e55-8cad-e5fad44166da', '97b8e102-d0da-48e9-8b87-773dc4f9afbb', '0532b8f2-180c-494b-96f1-ba3e1f2d64eb'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:50 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:50 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:51 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.947s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:51 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Deleted volume successfully. Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-00119e8e-1871-4c4c-86e6-835da1f358f4 tempest-ProjectReaderTests-529347886 None] Lock "cinder-7ec09f65-9763-4e07-9c2c-e0473ea2c994-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Flow 'volume_create_manager' (39797b3a-d322-4962-b2fe-b69757bba908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5606077-fe67-4359-8a0c-a4d37a8137f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5606077-fe67-4359-8a0c-a4d37a8137f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334064138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5244373-7f92-464a-ae47-b8ea7794261f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e2ff28a73b454591b82e951d4fd1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:51Z,use_quota=True,user_id='ff4083c1c27c414ebd7ea6cbb232ad43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b621bb-e5ed-4ac6-ab00-b5bdd3320801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b621bb-e5ed-4ac6-ab00-b5bdd3320801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f807b6-5546-423a-bf1f-e9f6e5dc8df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f807b6-5546-423a-bf1f-e9f6e5dc8df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5244373-7f92-464a-ae47-b8ea7794261f', 'volume_name': 'volume-e5244373-7f92-464a-ae47-b8ea7794261f', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c47e1a-bfc5-4a91-b3c2-ae5f09bc4c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c47e1a-bfc5-4a91-b3c2-ae5f09bc4c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c5d24a-1ec8-4f34-b7a0-acab72002b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:51 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Volume e5244373-7f92-464a-ae47-b8ea7794261f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5244373-7f92-464a-ae47-b8ea7794261f', 'volume_size': 1} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334064138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5244373-7f92-464a-ae47-b8ea7794261f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e2ff28a73b454591b82e951d4fd1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:51Z,use_quota=True,user_id='ff4083c1c27c414ebd7ea6cbb232ad43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Creating volume e5244373-7f92-464a-ae47-b8ea7794261f {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:51 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:51 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f 1073741824 Jul 09 03:19:51 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:52 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f 1073741824" returned: 0 in 0.983s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:52 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f Jul 09 03:19:52 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:53 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f" returned: 0 in 0.704s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:53 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c5d24a-1ec8-4f34-b7a0-acab72002b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5244373-7f92-464a-ae47-b8ea7794261f', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0eb45a6-7648-41fd-a20a-a4b87aae556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:53 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Volume volume-e5244373-7f92-464a-ae47-b8ea7794261f (e5244373-7f92-464a-ae47-b8ea7794261f): created successfully Jul 09 03:19:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0eb45a6-7648-41fd-a20a-a4b87aae556e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Flow 'volume_create_manager' (39797b3a-d322-4962-b2fe-b69757bba908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:53 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c486a0e6-e075-407c-8634-a5203afe545a tempest-ProjectReaderTests-529347886 None] Created volume successfully. Jul 09 03:19:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Acquiring lock "cinder-e5244373-7f92-464a-ae47-b8ea7794261f-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Lock "cinder-e5244373-7f92-464a-ae47-b8ea7794261f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Acquiring lock "cinder-quobyte-e5244373-7f92-464a-ae47-b8ea7794261f" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:19:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Lock "cinder-quobyte-e5244373-7f92-464a-ae47-b8ea7794261f" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:19:54 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d035edc5-02ed-4022-b33d-3a3d57e4ed0c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:19:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:54 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f Jul 09 03:19:54 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:55 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f" returned: 0 in 0.901s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:55 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f Jul 09 03:19:55 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:56 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5244373-7f92-464a-ae47-b8ea7794261f" returned: 0 in 0.729s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Lock "cinder-quobyte-e5244373-7f92-464a-ae47-b8ea7794261f" released by "delete_volume" :: held 1.696s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:56 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Created reservations ['c0239384-0a88-473b-ba98-cf4cac731191', '603f0e9a-0175-4431-93ec-dd45bea6df03', '93f0a642-a079-4e96-ad73-4a6aae1778c4', '1387bfa5-ae91-401b-b59c-4e18bc2be48a'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:19:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:56 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:19:56 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:57 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.762s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:19:57 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Deleted volume successfully. Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-eace32d7-d946-4a24-be39-69e3320b9509 tempest-ProjectReaderTests-529347886 None] Lock "cinder-e5244373-7f92-464a-ae47-b8ea7794261f-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Flow 'volume_create_manager' (e95d553f-e525-46c3-a654-c8b362ac5e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a37adcc-b521-4da7-acc4-7995ca6d2f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a37adcc-b521-4da7-acc4-7995ca6d2f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692169220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7117d5-ddbb-4c3b-bbae-3d1fd744b231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e2ff28a73b454591b82e951d4fd1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:57Z,use_quota=True,user_id='ff4083c1c27c414ebd7ea6cbb232ad43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cb197b-78a7-4636-9ec0-2921c75f7e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cb197b-78a7-4636-9ec0-2921c75f7e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5c89da-f8c1-419f-a6d1-68c60dd0bfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5c89da-f8c1-419f-a6d1-68c60dd0bfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7117d5-ddbb-4c3b-bbae-3d1fd744b231', 'volume_name': 'volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e1a720-2842-413d-a40c-ef52890ba481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e1a720-2842-413d-a40c-ef52890ba481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa169afc-c2ff-4a3c-a082-4df0752c1c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:57 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Volume 9b7117d5-ddbb-4c3b-bbae-3d1fd744b231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231', 'volume_size': 1} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692169220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7117d5-ddbb-4c3b-bbae-3d1fd744b231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e2ff28a73b454591b82e951d4fd1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:19:57Z,use_quota=True,user_id='ff4083c1c27c414ebd7ea6cbb232ad43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Creating volume 9b7117d5-ddbb-4c3b-bbae-3d1fd744b231 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:19:57 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:19:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:57 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231 1073741824 Jul 09 03:19:57 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:58 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231 1073741824" returned: 0 in 0.996s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:19:58 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231 Jul 09 03:19:58 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:19:59 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 09 03:19:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231" returned: 0 in 0.743s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:19:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:19:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:19:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa169afc-c2ff-4a3c-a082-4df0752c1c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f11a2a-37a7-418d-bbe6-86f7dc390278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:19:59 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Volume volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231 (9b7117d5-ddbb-4c3b-bbae-3d1fd744b231): created successfully Jul 09 03:19:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f11a2a-37a7-418d-bbe6-86f7dc390278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:19:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Flow 'volume_create_manager' (e95d553f-e525-46c3-a654-c8b362ac5e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:19:59 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-63b1c34d-c718-413d-b64a-7f7c644aa149 tempest-ProjectReaderTests-529347886 None] Created volume successfully. Jul 09 03:20:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Acquiring lock "cinder-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:20:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Lock "cinder-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:20:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Acquiring lock "cinder-quobyte-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:20:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Lock "cinder-quobyte-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:20:00 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30e46b0-0c8e-4eeb-912d-088ef0172067]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:20:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:00 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231 Jul 09 03:20:00 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:01 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231" returned: 0 in 0.990s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:01 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231 Jul 09 03:20:01 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:02 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231" returned: 0 in 0.735s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Lock "cinder-quobyte-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231" released by "delete_volume" :: held 1.780s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:20:02 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=152,cinder:DELETE=11,cinder:SELECT=107,cinder:INSERT=35 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:20:02 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=145,cinder:SELECT=99,cinder:INSERT=33,cinder:DELETE=15 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:20:02 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Created reservations ['4cc14724-6708-43d2-8ebf-a1dd59cf4405', 'bd3f3e00-7adc-4140-9a69-78341f7fdc3e', '6f2c5ad1-84f9-41b6-a2e9-bd3fa025c6a0', 'd611e49e-4cb7-48d3-bac3-f7c5146acf23'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:20:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:20:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:20:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:02 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:20:02 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:03 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.890s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:03 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:20:03 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Deleted volume successfully. Jul 09 03:20:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf981337-628f-4e82-81ff-764867c7cda9 tempest-ProjectReaderTests-529347886 None] Lock "cinder-9b7117d5-ddbb-4c3b-bbae-3d1fd744b231-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Flow 'volume_create_manager' (f5892e2d-ba29-4682-82ec-0017116eafe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380b13b2-1c3f-4791-be05-9c07bd0145af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380b13b2-1c3f-4791-be05-9c07bd0145af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1105588709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fc7dfb-21c6-401b-88e8-152d9be989c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c40de34ea14974aebaca1dbed50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:20:07Z,use_quota=True,user_id='82d7d7133cad4847b7c7afefadb0aa7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c006da6c-e732-477a-9e8c-0ca8a3142f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c006da6c-e732-477a-9e8c-0ca8a3142f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767acb11-ca86-4cee-adff-595a3d3e176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767acb11-ca86-4cee-adff-595a3d3e176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89fc7dfb-21c6-401b-88e8-152d9be989c1', 'volume_name': 'volume-89fc7dfb-21c6-401b-88e8-152d9be989c1', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a3bb30-b15d-4d56-9867-98b396afbb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a3bb30-b15d-4d56-9867-98b396afbb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9702191-6b36-42f7-9c2d-18866a884eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:07 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Volume 89fc7dfb-21c6-401b-88e8-152d9be989c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89fc7dfb-21c6-401b-88e8-152d9be989c1', 'volume_size': 1} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1105588709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fc7dfb-21c6-401b-88e8-152d9be989c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c40de34ea14974aebaca1dbed50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:20:07Z,use_quota=True,user_id='82d7d7133cad4847b7c7afefadb0aa7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Creating volume 89fc7dfb-21c6-401b-88e8-152d9be989c1 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:20:07 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:20:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:07 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 1073741824 Jul 09 03:20:07 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:08 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 1073741824" returned: 0 in 0.933s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:08 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 Jul 09 03:20:08 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:08 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1" returned: 0 in 0.691s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:20:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9702191-6b36-42f7-9c2d-18866a884eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89fc7dfb-21c6-401b-88e8-152d9be989c1', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd4622d-52cc-4995-869f-9d04478b4586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:08 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Volume volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 (89fc7dfb-21c6-401b-88e8-152d9be989c1): created successfully Jul 09 03:20:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd4622d-52cc-4995-869f-9d04478b4586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Flow 'volume_create_manager' (f5892e2d-ba29-4682-82ec-0017116eafe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:20:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9712ce5b-ba81-4a16-ad20-a9493b370669 tempest-SnapshotDependencyTests-693030972 None] Created volume successfully. Jul 09 03:20:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] Creating offline snapshot de21cefb-dd85-43e6-87fb-f748eb2d6b6a of volume 89fc7dfb-21c6-401b-88e8-152d9be989c1 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:20:09 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9f1b77-23cd-4886-8ac9-f3670209b623]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:20:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:09 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 Jul 09 03:20:09 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:10 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1" returned: 0 in 0.781s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:10 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a 1G Jul 09 03:20:10 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:11 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a 1G" returned: 0 in 0.872s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:11 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a Jul 09 03:20:11 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:11 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a" returned: 0 in 0.748s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:11 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a is being set with open permissions: ugo+rw Jul 09 03:20:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:11 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a Jul 09 03:20:11 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:12 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a" returned: 0 in 0.750s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:12 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.info Jul 09 03:20:12 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:13 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.info" returned: 0 in 0.721s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:13 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.info is being set with open permissions: ugo+rw Jul 09 03:20:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:13 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.info Jul 09 03:20:13 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:20:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:20:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:20:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:13 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:20:13 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:14 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.info" returned: 0 in 0.685s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.671s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:14 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-328b7e26-d806-4238-8f4b-fa6c06ed4b53 tempest-SnapshotDependencyTests-693030972 None] Create snapshot completed successfully Jul 09 03:20:14 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.697s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:20:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:20:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:20:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Flow 'volume_create_manager' (44d6963d-0522-46a8-841f-8c24266ae952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f028dce-6fe3-465a-a4ff-82196de9ea16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f028dce-6fe3-465a-a4ff-82196de9ea16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c40de34ea14974aebaca1dbed50760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de21cefb-dd85-43e6-87fb-f748eb2d6b6a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:20:15Z,use_quota=True,user_id='82d7d7133cad4847b7c7afefadb0aa7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ea8557-5341-4bb1-8aeb-77c84d3c6e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ea8557-5341-4bb1-8aeb-77c84d3c6e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b777dfb-b13e-434b-bf72-e7633aa6c38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b777dfb-b13e-434b-bf72-e7633aa6c38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d', 'volume_name': 'volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d', 'volume_size': 1, 'snapshot_id': 'de21cefb-dd85-43e6-87fb-f748eb2d6b6a'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323e553c-1ac2-471f-a86a-32dbb86fa96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323e553c-1ac2-471f-a86a-32dbb86fa96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61a02ef-f5ed-4532-b3d1-c01d2f1f995b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:15 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Volume 8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d', 'volume_size': 1, 'snapshot_id': 'de21cefb-dd85-43e6-87fb-f748eb2d6b6a'} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "cinder-quobyte-de21cefb-dd85-43e6-87fb-f748eb2d6b6a-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" by "_create_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-de21cefb-dd85-43e6-87fb-f748eb2d6b6a-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Creating volume 8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d from snapshot de21cefb-dd85-43e6-87fb-f748eb2d6b6a {{(pid=87216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "cinder-quobyte-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] snapshot: de21cefb-dd85-43e6-87fb-f748eb2d6b6a, volume: 8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3ea3c1-d8b3-40af-b9a5-30172ab85f63]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:15 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a Jul 09 03:20:15 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Flow 'volume_create_manager' (793fc90a-3651-4781-90bd-35fe97436b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a885e2-531b-4ecf-821c-129417bcd903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a885e2-531b-4ecf-821c-129417bcd903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1212648182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d05120d-1744-447e-945b-9240f4250a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='694255d2712a46138fa05ae20b8fae35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:20:16Z,use_quota=True,user_id='5905bc36262941b1be4b55ad3237d10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd11d59-a2fe-41e3-832d-414314ce1858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd11d59-a2fe-41e3-832d-414314ce1858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abcb0ac-d812-4132-89a3-7c61bdf068e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abcb0ac-d812-4132-89a3-7c61bdf068e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d05120d-1744-447e-945b-9240f4250a77', 'volume_name': 'volume-8d05120d-1744-447e-945b-9240f4250a77', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4832e8ae-e6ac-4c31-9828-16ba7205b470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4832e8ae-e6ac-4c31-9828-16ba7205b470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e1fa64-8461-478d-a777-85826f4612e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:15 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Volume 8d05120d-1744-447e-945b-9240f4250a77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d05120d-1744-447e-945b-9240f4250a77', 'volume_size': 1} Jul 09 03:20:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:16 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a" returned: 0 in 0.832s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89fc7dfb-21c6-401b-88e8-152d9be989c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:20:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:20:16 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:20:16 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[215b088e-9724-4b4a-a8fe-9f52dabb112d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:20:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:16 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 Jul 09 03:20:16 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:17 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1" returned: 0 in 0.801s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:17 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:20:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:17 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d Jul 09 03:20:17 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:22 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" returned: 0 in 5.170s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:22 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d5ff1c-2fa2-42c7-be93-9f94893e861d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:20:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:22 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 Jul 09 03:20:22 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:23 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1" returned: 0 in 1.000s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1, size 1024.00 MB, duration 5.17 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:20:23 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Converted 1024.00 MB image at 198.01 MB/s Jul 09 03:20:23 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d is being set with open permissions: ugo+rw Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:23 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d Jul 09 03:20:23 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:23 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" returned: 0 in 0.635s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" released by "_copy_volume_from_snapshot" :: held 8.560s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-de21cefb-dd85-43e6-87fb-f748eb2d6b6a-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" released by "_create_volume_from_snapshot" :: held 8.589s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.603s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.193s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1212648182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d05120d-1744-447e-945b-9240f4250a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='694255d2712a46138fa05ae20b8fae35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:20:16Z,use_quota=True,user_id='5905bc36262941b1be4b55ad3237d10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Creating volume 8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:20:23 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:20:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:24 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 1073741824 Jul 09 03:20:24 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61a02ef-f5ed-4532-b3d1-c01d2f1f995b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d', 'volume_size': 1, 'snapshot_id': 'de21cefb-dd85-43e6-87fb-f748eb2d6b6a'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbf8775-5c2a-4d61-97f7-e3b7945e7bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:24 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Volume volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d (8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d): created successfully Jul 09 03:20:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbf8775-5c2a-4d61-97f7-e3b7945e7bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Flow 'volume_create_manager' (44d6963d-0522-46a8-841f-8c24266ae952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:20:24 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bf3884f7-c30c-42b4-aa49-9813408d05cb tempest-SnapshotDependencyTests-693030972 None] Created volume successfully. Jul 09 03:20:24 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 1073741824" returned: 0 in 0.834s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:24 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 Jul 09 03:20:24 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "cinder-de21cefb-dd85-43e6-87fb-f748eb2d6b6a-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-de21cefb-dd85-43e6-87fb-f748eb2d6b6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "cinder-quobyte-89fc7dfb-21c6-401b-88e8-152d9be989c1" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-89fc7dfb-21c6-401b-88e8-152d9be989c1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "cinder-quobyte-de21cefb-dd85-43e6-87fb-f748eb2d6b6a" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-de21cefb-dd85-43e6-87fb-f748eb2d6b6a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Deleting offline snapshot de21cefb-dd85-43e6-87fb-f748eb2d6b6a of volume 89fc7dfb-21c6-401b-88e8-152d9be989c1 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] snapshot_file for this snap is: volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e024310-975f-4147-81e5-312a2ea83281]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:25 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a Jul 09 03:20:25 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:25 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77" returned: 0 in 0.692s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e1fa64-8461-478d-a777-85826f4612e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d05120d-1744-447e-945b-9240f4250a77', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cfd570-0a82-4813-b41e-87cf50f5a4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:20:25 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Volume volume-8d05120d-1744-447e-945b-9240f4250a77 (8d05120d-1744-447e-945b-9240f4250a77): created successfully Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cfd570-0a82-4813-b41e-87cf50f5a4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:20:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Flow 'volume_create_manager' (793fc90a-3651-4781-90bd-35fe97436b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:20:25 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bc08be13-de56-40c4-b9b2-44e06fda3253 tempest-TestStampPattern-616736136 None] Created volume successfully. Jul 09 03:20:26 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a" returned: 0 in 0.779s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89fc7dfb-21c6-401b-88e8-152d9be989c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:20:26 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a91fd4-2777-4509-9148-b3b1e4836d6f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:20:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:26 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 Jul 09 03:20:26 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:26 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1" returned: 0 in 0.902s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:26 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a Jul 09 03:20:26 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:27 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a" returned: 0 in 0.878s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:27 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a Jul 09 03:20:27 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:28 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1.de21cefb-dd85-43e6-87fb-f748eb2d6b6a" returned: 0 in 0.665s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-de21cefb-dd85-43e6-87fb-f748eb2d6b6a" released by "_delete_snapshot" :: held 3.348s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:20:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-89fc7dfb-21c6-401b-88e8-152d9be989c1" released by "delete_snapshot" :: held 3.372s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:20:28 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Created reservations ['eeb5cc6a-be74-4506-b97c-9be3308dbf08', 'b30e9eb5-ff42-44ca-bbd8-4cbca32d7ca9', '586a57c4-7ffa-437c-be75-1d1317dbbd5b', 'a92e714b-3009-49b5-85d7-a711afe1b59b'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:20:28 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Delete snapshot completed successfully. Jul 09 03:20:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-867cd490-caa6-4a12-9dce-6a2c60e7906c tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-de21cefb-dd85-43e6-87fb-f748eb2d6b6a-delete_snapshot" released by "delete_snapshot" :: held 3.519s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:20:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "cinder-89fc7dfb-21c6-401b-88e8-152d9be989c1-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:20:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-89fc7dfb-21c6-401b-88e8-152d9be989c1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:20:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "cinder-quobyte-89fc7dfb-21c6-401b-88e8-152d9be989c1" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:20:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-89fc7dfb-21c6-401b-88e8-152d9be989c1" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:20:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a928ed-778a-49be-a787-643e983b506a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:20:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:29 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 Jul 09 03:20:29 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:30 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1" returned: 0 in 0.814s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:30 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1 Jul 09 03:20:30 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:31 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-89fc7dfb-21c6-401b-88e8-152d9be989c1" returned: 0 in 0.720s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-89fc7dfb-21c6-401b-88e8-152d9be989c1" released by "delete_volume" :: held 1.594s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Created reservations ['e819d017-4ece-417b-b583-92c9f022e840', '01e3c350-48f1-4489-8211-791d67be5f73', 'c8ae1479-ad18-4f61-8041-67f82658146a', 'a3478c0e-ddb6-4cfd-bbea-cf7d25d3928a'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:31 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:20:31 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "cinder-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "cinder-quobyte-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86026cb-162c-4226-b8e0-7007a97e66bc]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:31 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.766s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:20:31 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Deleted volume successfully. Jul 09 03:20:31 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d Jul 09 03:20:31 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-923d896f-8695-4aec-a21c-1f8c5e5fb6c5 tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-89fc7dfb-21c6-401b-88e8-152d9be989c1-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:20:32 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" returned: 0 in 0.842s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:32 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d Jul 09 03:20:32 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:33 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" returned: 0 in 0.677s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-quobyte-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d" released by "delete_volume" :: held 1.584s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:20:33 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Created reservations ['395f1e7f-4ee1-4469-88af-87472624b6ba', 'c90465df-84fa-4089-97ab-853882e17dfa', '7f9f37d6-0b0c-49be-9cfd-90c13fbacc81', 'f88ef4b8-fa33-4198-adf6-a8fca78b15f5'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:20:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:20:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:20:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:33 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:20:33 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:34 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.790s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:34 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:20:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Deleted volume successfully. Jul 09 03:20:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-291c4bf3-9f4f-44c4-8e45-57e4bccea1b5 tempest-SnapshotDependencyTests-693030972 None] Lock "cinder-8d6873b8-75ef-4ab3-9e07-2b0d934ebe2d-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:20:43 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=33,cinder:INSERT=9,cinder:UPDATE=44,cinder:DELETE=4 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:20:44 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=33,cinder:SELECT=24,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:20:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-4843bb94-7a2a-4a9a-8f93-8033d140b2a9 req-bcff672f-1540-4591-8e7a-def6bc672a87 tempest-TestStampPattern-616736136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:20:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-4843bb94-7a2a-4a9a-8f93-8033d140b2a9 req-bcff672f-1540-4591-8e7a-def6bc672a87 tempest-TestStampPattern-616736136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:20:56 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[017b3a96-ce71-4d7b-9bac-818315cff28e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:20:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-4843bb94-7a2a-4a9a-8f93-8033d140b2a9 req-bcff672f-1540-4591-8e7a-def6bc672a87 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:20:57 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 Jul 09 03:20:57 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:20:57 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Jul 09 03:20:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-4843bb94-7a2a-4a9a-8f93-8033d140b2a9 req-bcff672f-1540-4591-8e7a-def6bc672a87 tempest-TestStampPattern-616736136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77" returned: 0 in 0.758s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:20:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-4843bb94-7a2a-4a9a-8f93-8033d140b2a9 req-bcff672f-1540-4591-8e7a-def6bc672a87 tempest-TestStampPattern-616736136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.774s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:20:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-4843bb94-7a2a-4a9a-8f93-8033d140b2a9 req-bcff672f-1540-4591-8e7a-def6bc672a87 tempest-TestStampPattern-616736136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-8d05120d-1744-447e-945b-9240f4250a77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '323c5df7-7d4b-4c6a-be11-c9cd5cd2a9a4', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:20:57 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-4843bb94-7a2a-4a9a-8f93-8033d140b2a9 req-bcff672f-1540-4591-8e7a-def6bc672a87 tempest-TestStampPattern-616736136 None] attachment_update completed successfully. Jul 09 03:21:06 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-2b9327c6-68f4-43e7-87f9-becf46a7019f req-f26732de-2d34-4e03-95ad-d691553ef1df tempest-TestStampPattern-616736136 None] Terminate volume connection completed successfully. Jul 09 03:21:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-2b9327c6-68f4-43e7-87f9-becf46a7019f req-f26732de-2d34-4e03-95ad-d691553ef1df tempest-TestStampPattern-616736136 None] Deleting attachment 323c5df7-7d4b-4c6a-be11-c9cd5cd2a9a4. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:21:07 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:21:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:21:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:21:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] Creating offline snapshot 27c65f80-2bde-41ac-8638-e7fa5f85c992 of volume 8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:21:08 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e62a92-f783-4955-ba9c-f51fc7f097c5]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:21:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:08 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 Jul 09 03:21:08 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:08 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77" returned: 0 in 0.777s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:09 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 1G Jul 09 03:21:09 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:09 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 1G" returned: 0 in 0.780s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d05120d-1744-447e-945b-9240f4250a77 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:09 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d05120d-1744-447e-945b-9240f4250a77 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 Jul 09 03:21:09 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:10 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d05120d-1744-447e-945b-9240f4250a77 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992" returned: 0 in 0.670s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:10 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 is being set with open permissions: ugo+rw Jul 09 03:21:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:10 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 Jul 09 03:21:10 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:11 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992" returned: 0 in 0.655s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:11 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.info Jul 09 03:21:11 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:11 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.info" returned: 0 in 0.653s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:11 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.info is being set with open permissions: ugo+rw Jul 09 03:21:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:11 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.info Jul 09 03:21:11 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:12 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.info" returned: 0 in 0.635s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.251s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:21:12 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2bba541a-439d-4f69-805c-de52de9ce833 tempest-TestStampPattern-616736136 None] Create snapshot completed successfully Jul 09 03:21:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:21:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:21:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:21:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:21:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:21:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:21:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:13 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:21:13 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:14 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.687s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:21:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:21:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:21:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:21:22 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:21:22 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Flow 'volume_create_manager' (1bdef5ce-7264-4a52-9120-584d8ce122cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ab0ad5-92c8-454e-8e91-58c2c70a2d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ab0ad5-92c8-454e-8e91-58c2c70a2d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-667880344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d2d206-c80b-462c-b69c-0023d5e40f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='694255d2712a46138fa05ae20b8fae35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=27c65f80-2bde-41ac-8638-e7fa5f85c992,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:21:23Z,use_quota=True,user_id='5905bc36262941b1be4b55ad3237d10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51be129f-e548-42fe-9910-26fecc22fda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51be129f-e548-42fe-9910-26fecc22fda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca6a2c2-2046-4ca2-b409-272ff4cb45b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca6a2c2-2046-4ca2-b409-272ff4cb45b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '70d2d206-c80b-462c-b69c-0023d5e40f16', 'volume_name': 'volume-70d2d206-c80b-462c-b69c-0023d5e40f16', 'volume_size': 1, 'snapshot_id': '27c65f80-2bde-41ac-8638-e7fa5f85c992'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9293ce9-a50e-40f9-9a6d-a0ab838247a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9293ce9-a50e-40f9-9a6d-a0ab838247a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2bad71-5e49-46f5-9b55-6f4b24b74dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:21:23 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Volume 70d2d206-c80b-462c-b69c-0023d5e40f16: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-70d2d206-c80b-462c-b69c-0023d5e40f16', 'volume_size': 1, 'snapshot_id': '27c65f80-2bde-41ac-8638-e7fa5f85c992'} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Acquiring lock "cinder-quobyte-27c65f80-2bde-41ac-8638-e7fa5f85c992-70d2d206-c80b-462c-b69c-0023d5e40f16" by "_create_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-27c65f80-2bde-41ac-8638-e7fa5f85c992-70d2d206-c80b-462c-b69c-0023d5e40f16" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Creating volume 70d2d206-c80b-462c-b69c-0023d5e40f16 from snapshot 27c65f80-2bde-41ac-8638-e7fa5f85c992 {{(pid=87216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Acquiring lock "cinder-quobyte-70d2d206-c80b-462c-b69c-0023d5e40f16" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-70d2d206-c80b-462c-b69c-0023d5e40f16" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] snapshot: 27c65f80-2bde-41ac-8638-e7fa5f85c992, volume: 70d2d206-c80b-462c-b69c-0023d5e40f16, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3d976b-20ec-47db-9529-567ff20afd72]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:21:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:23 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 Jul 09 03:21:23 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:24 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992" returned: 0 in 0.801s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d05120d-1744-447e-945b-9240f4250a77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:21:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:21:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:21:24 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8e87ec-f4c1-4e29-a780-a160f4478426]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:21:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:24 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 Jul 09 03:21:24 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:24 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77" returned: 0 in 0.772s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:24 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:21:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:24 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 Jul 09 03:21:24 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:29 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16" returned: 0 in 5.017s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe6dd45-5de3-4a77-8dc2-96d7d271f37e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:21:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:30 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 Jul 09 03:21:30 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:31 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77" returned: 0 in 1.042s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:31 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:21:31 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Converted 1024.00 MB image at 204.07 MB/s Jul 09 03:21:31 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 is being set with open permissions: ugo+rw Jul 09 03:21:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:21:31 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 Jul 09 03:21:31 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:21:31 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 09 03:21:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16" returned: 0 in 0.788s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:21:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-70d2d206-c80b-462c-b69c-0023d5e40f16" released by "_copy_volume_from_snapshot" :: held 8.531s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:21:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-27c65f80-2bde-41ac-8638-e7fa5f85c992-70d2d206-c80b-462c-b69c-0023d5e40f16" released by "_create_volume_from_snapshot" :: held 8.562s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:21:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.578s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:21:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2bad71-5e49-46f5-9b55-6f4b24b74dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d2d206-c80b-462c-b69c-0023d5e40f16', 'volume_size': 1, 'snapshot_id': '27c65f80-2bde-41ac-8638-e7fa5f85c992'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:21:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace43a70-b1a8-47d0-9d4b-a79b6620be66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:21:31 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Volume volume-70d2d206-c80b-462c-b69c-0023d5e40f16 (70d2d206-c80b-462c-b69c-0023d5e40f16): created successfully Jul 09 03:21:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace43a70-b1a8-47d0-9d4b-a79b6620be66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:21:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Flow 'volume_create_manager' (1bdef5ce-7264-4a52-9120-584d8ce122cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:21:31 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-758402fa-7b14-4a3a-9b74-7ba056e6f563 tempest-TestStampPattern-616736136 None] Created volume successfully. Jul 09 03:21:41 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:21:41 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:22:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:22:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:22:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:22:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:22:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:22:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:22:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:13 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:22:13 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:14 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.644s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:22:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:22:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:22:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:22:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-a7dd39ed-4785-4f78-96e0-8da14168d886 req-5859957f-a28a-4908-8c87-4a03062c6c71 tempest-TestStampPattern-616736136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:22:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-a7dd39ed-4785-4f78-96e0-8da14168d886 req-5859957f-a28a-4908-8c87-4a03062c6c71 tempest-TestStampPattern-616736136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:22:20 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4851ea3b-ce03-4a1c-9d15-f6230374f3ff]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:22:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-a7dd39ed-4785-4f78-96e0-8da14168d886 req-5859957f-a28a-4908-8c87-4a03062c6c71 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:20 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 Jul 09 03:22:20 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:21 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [req-a7dd39ed-4785-4f78-96e0-8da14168d886 req-5859957f-a28a-4908-8c87-4a03062c6c71 tempest-TestStampPattern-616736136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16" returned: 0 in 0.746s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [req-a7dd39ed-4785-4f78-96e0-8da14168d886 req-5859957f-a28a-4908-8c87-4a03062c6c71 tempest-TestStampPattern-616736136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.763s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:22:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-a7dd39ed-4785-4f78-96e0-8da14168d886 req-5859957f-a28a-4908-8c87-4a03062c6c71 tempest-TestStampPattern-616736136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b', 'name': 'volume-70d2d206-c80b-462c-b69c-0023d5e40f16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '173fb0ef-fda9-4372-8ff3-6b2e0e18e167', 'enforce_multipath': True} {{(pid=87216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:22:21 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-a7dd39ed-4785-4f78-96e0-8da14168d886 req-5859957f-a28a-4908-8c87-4a03062c6c71 tempest-TestStampPattern-616736136 None] attachment_update completed successfully. Jul 09 03:22:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [req-99447627-7ba9-4083-839b-f40d4cf965a5 req-d47c7167-d5c7-4dd8-8ccd-9f8f2f9217af tempest-TestStampPattern-616736136 None] Terminate volume connection completed successfully. Jul 09 03:22:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [req-99447627-7ba9-4083-839b-f40d4cf965a5 req-d47c7167-d5c7-4dd8-8ccd-9f8f2f9217af tempest-TestStampPattern-616736136 None] Deleting attachment 173fb0ef-fda9-4372-8ff3-6b2e0e18e167. {{(pid=87216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:22:31 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:22:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Acquiring lock "cinder-70d2d206-c80b-462c-b69c-0023d5e40f16-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:22:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Lock "cinder-70d2d206-c80b-462c-b69c-0023d5e40f16-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:22:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Acquiring lock "cinder-quobyte-70d2d206-c80b-462c-b69c-0023d5e40f16" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:22:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-70d2d206-c80b-462c-b69c-0023d5e40f16" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:22:37 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df66575-675c-43ba-aec1-faf9e18fffd8]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:22:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:37 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 Jul 09 03:22:37 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:38 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16" returned: 0 in 0.753s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:38 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16 Jul 09 03:22:38 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:39 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-70d2d206-c80b-462c-b69c-0023d5e40f16" returned: 0 in 0.629s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-70d2d206-c80b-462c-b69c-0023d5e40f16" released by "delete_volume" :: held 1.419s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Created reservations ['630ac7e6-1dd9-4678-8bb2-4584adbbcfaa', 'f357ce25-5caa-4f92-b7b6-d2fa21b316e1', '26e63f51-3699-43e1-a587-2efc81310014', '55cb9506-8a36-40d8-be05-75986505704d'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:39 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:22:39 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:39 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.646s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:22:39 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Deleted volume successfully. Jul 09 03:22:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-450c51bc-70cd-4387-9a94-d726c38f1964 tempest-TestStampPattern-616736136 None] Lock "cinder-70d2d206-c80b-462c-b69c-0023d5e40f16-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Acquiring lock "cinder-27c65f80-2bde-41ac-8638-e7fa5f85c992-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Lock "cinder-27c65f80-2bde-41ac-8638-e7fa5f85c992-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Acquiring lock "cinder-quobyte-8d05120d-1744-447e-945b-9240f4250a77" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-8d05120d-1744-447e-945b-9240f4250a77" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Acquiring lock "cinder-quobyte-27c65f80-2bde-41ac-8638-e7fa5f85c992" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-27c65f80-2bde-41ac-8638-e7fa5f85c992" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Deleting offline snapshot 27c65f80-2bde-41ac-8638-e7fa5f85c992 of volume 8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] snapshot_file for this snap is: volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa990ca-7950-481a-b48e-fb79c329c166]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:40 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 Jul 09 03:22:40 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:40 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992" returned: 0 in 0.751s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d05120d-1744-447e-945b-9240f4250a77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cfd191-91b5-42c8-a04c-26c1fc1406cf]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:22:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:40 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 Jul 09 03:22:40 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:41 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77" returned: 0 in 0.753s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:41 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 Jul 09 03:22:41 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:42 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992" returned: 0 in 0.715s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:42 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992 Jul 09 03:22:42 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:42 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77.27c65f80-2bde-41ac-8638-e7fa5f85c992" returned: 0 in 0.633s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-27c65f80-2bde-41ac-8638-e7fa5f85c992" released by "_delete_snapshot" :: held 2.943s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:22:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-8d05120d-1744-447e-945b-9240f4250a77" released by "delete_snapshot" :: held 2.963s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:22:43 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Created reservations ['2684c2aa-b12a-4a8e-9e03-5781d5f06ae0', '7adbe54a-38f5-4b59-9398-74df2486da5e', '57f53555-f982-4202-8a66-89a8c6bb8203', 'ebffff16-a60a-4795-807f-d96a0202b060'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:22:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Delete snapshot completed successfully. Jul 09 03:22:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0dc49ab8-01de-4dcd-b778-e59cf65f9772 tempest-TestStampPattern-616736136 None] Lock "cinder-27c65f80-2bde-41ac-8638-e7fa5f85c992-delete_snapshot" released by "delete_snapshot" :: held 3.087s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:22:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Acquiring lock "cinder-8d05120d-1744-447e-945b-9240f4250a77-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:22:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Lock "cinder-8d05120d-1744-447e-945b-9240f4250a77-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:22:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Acquiring lock "cinder-quobyte-8d05120d-1744-447e-945b-9240f4250a77" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:22:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-8d05120d-1744-447e-945b-9240f4250a77" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:22:51 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[951ccbc2-cd1a-400f-aa71-13b556f1b99f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:22:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:51 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 Jul 09 03:22:51 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:52 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77" returned: 0 in 0.761s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:52 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77 Jul 09 03:22:52 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:52 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8d05120d-1744-447e-945b-9240f4250a77" returned: 0 in 0.644s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Lock "cinder-quobyte-8d05120d-1744-447e-945b-9240f4250a77" released by "delete_volume" :: held 1.460s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:22:52 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Created reservations ['ffa61bd0-4f0b-4cb1-b073-d00dbbd388d2', '9c1edb69-0dc1-4def-a580-75cc4aabd672', '9a75a2f8-d1cb-4a8b-903e-df3dc8144c65', 'e67af51d-a407-4ffe-8425-e5d51195f5d2'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:22:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:22:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:22:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:22:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:22:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:22:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:22:52 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:22:52 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:22:53 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 09 03:22:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.639s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:22:53 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:22:53 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Deleted volume successfully. Jul 09 03:22:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e9f44cf-5b92-462c-b6de-bf4c86f3df0f tempest-TestStampPattern-616736136 None] Lock "cinder-8d05120d-1744-447e-945b-9240f4250a77-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:02 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=21,cinder:SELECT=17,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:23:03 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=22,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Flow 'volume_create_manager' (fd122b0c-1af3-4b5f-890f-7f564b3ae27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928a2cec-7679-4734-a849-3d46b416aebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928a2cec-7679-4734-a849-3d46b416aebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28179245-f1fb-494b-bfd0-601e5cdb5660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8bf0718443e497ea89d3cd1c82b0145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:06Z,use_quota=True,user_id='d05bdd3d4ef945ae9a8b0a5bef7ae316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(461f3b58-bbaf-41c6-ac38-dac958706d9f),volume_type_id=461f3b58-bbaf-41c6-ac38-dac958706d9f)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e020b15-4538-4489-bb25-d9d32084a3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e020b15-4538-4489-bb25-d9d32084a3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44041326-c305-4919-b695-3a42b88db619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.image.glance [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Creating Keystone auth plugin from conf {{(pid=87216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44041326-c305-4919-b695-3a42b88db619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '28179245-f1fb-494b-bfd0-601e5cdb5660', 'volume_name': 'volume-28179245-f1fb-494b-bfd0-601e5cdb5660', 'volume_size': 1, 'image_id': '43bf484f-f193-410c-bcc9-5c77bd544632', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43bf484f-f193-410c-bcc9-5c77bd544632', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ffc3ec213a7c0b97fab9ee8b63724b19', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8bf0718443e497ea89d3cd1c82b0145', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '865e3df462c686ade8755f7d3341de876fce0b1522081f0ea09489028703a2fa1a43b75f560527982d92a8b3d04dd233d5d5f7bd917a29d2d0b32ed67b80322e', 'id': '43bf484f-f193-410c-bcc9-5c77bd544632', 'created_at': datetime.datetime(2026, 7, 9, 1, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 23, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43bf484f-f193-410c-bcc9-5c77bd544632/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a957cb8-f4e9-4189-b9fa-7a72636c453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a957cb8-f4e9-4189-b9fa-7a72636c453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b200b9be-258e-45f5-bfeb-d8da6fb306e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:06 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Volume 28179245-f1fb-494b-bfd0-601e5cdb5660: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-28179245-f1fb-494b-bfd0-601e5cdb5660', 'volume_size': 1, 'image_id': '43bf484f-f193-410c-bcc9-5c77bd544632', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43bf484f-f193-410c-bcc9-5c77bd544632', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ffc3ec213a7c0b97fab9ee8b63724b19', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8bf0718443e497ea89d3cd1c82b0145', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '865e3df462c686ade8755f7d3341de876fce0b1522081f0ea09489028703a2fa1a43b75f560527982d92a8b3d04dd233d5d5f7bd917a29d2d0b32ed67b80322e', 'id': '43bf484f-f193-410c-bcc9-5c77bd544632', 'created_at': datetime.datetime(2026, 7, 9, 1, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 23, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43bf484f-f193-410c-bcc9-5c77bd544632/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Trying to clone 28179245-f1fb-494b-bfd0-601e5cdb5660 from image 43bf484f-f193-410c-bcc9-5c77bd544632 at location (None, [{'url': 'file:///opt/stack/data/glance/images/43bf484f-f193-410c-bcc9-5c77bd544632', 'metadata': {}}]). {{(pid=87216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:23:06 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Image download 0.00 MB at 0.00 MB/s Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2872b5bf-bfd7-4b36-a1c1-ffbe3ff5512e]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:06 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD Jul 09 03:23:06 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:07 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:07 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD Jul 09 03:23:07 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:08 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD" returned: 1 in 0.716s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:23:08 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Temporary image 43bf484f-f193-410c-bcc9-5c77bd544632 is fetched for user d05bdd3d4ef945ae9a8b0a5bef7ae316. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:23:08 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c838f7-8516-4777-87eb-5f3e5b766c86]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:08 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD Jul 09 03:23:08 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:09 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:09 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD Jul 09 03:23:09 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:09 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD" returned: 1 in 0.700s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28179245-f1fb-494b-bfd0-601e5cdb5660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8bf0718443e497ea89d3cd1c82b0145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:06Z,use_quota=True,user_id='d05bdd3d4ef945ae9a8b0a5bef7ae316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(461f3b58-bbaf-41c6-ac38-dac958706d9f),volume_type_id=461f3b58-bbaf-41c6-ac38-dac958706d9f)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Creating volume 28179245-f1fb-494b-bfd0-601e5cdb5660 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:23:09 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:23:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:09 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 1073741824 Jul 09 03:23:09 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:10 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 1073741824" returned: 0 in 0.818s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:10 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 Jul 09 03:23:10 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:11 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660" returned: 0 in 0.654s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:23:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:11 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Attempting download of 43bf484f-f193-410c-bcc9-5c77bd544632 ((None, [{'url': 'file:///opt/stack/data/glance/images/43bf484f-f193-410c-bcc9-5c77bd544632', 'metadata': {}}])) to volume 28179245-f1fb-494b-bfd0-601e5cdb5660. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:23:11 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8705a33b-b47a-4f2a-8981-f3d6611f654b]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43bf484f-f193-410c-bcc9-5c77bd544632_a9hyvgal {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:11 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43bf484f-f193-410c-bcc9-5c77bd544632_a9hyvgal Jul 09 03:23:11 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:12 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43bf484f-f193-410c-bcc9-5c77bd544632_a9hyvgal" returned: 0 in 0.735s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43bf484f-f193-410c-bcc9-5c77bd544632_a9hyvgal {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:12 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43bf484f-f193-410c-bcc9-5c77bd544632_a9hyvgal Jul 09 03:23:12 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:12 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43bf484f-f193-410c-bcc9-5c77bd544632_a9hyvgal" returned: 1 in 0.735s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43bf484f-f193-410c-bcc9-5c77bd544632_a9hyvgal' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:23:12 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4078a7d5-635f-4f31-a1a1-5c1c423ecf17]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:12 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD Jul 09 03:23:12 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:13 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD" returned: 0 in 0.710s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:13 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD Jul 09 03:23:13 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:23:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:13 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:23:13 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:14 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD" returned: 1 in 0.710s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] 43bf484f-f193-410c-bcc9-5c77bd544632 was raw, converting to raw {{(pid=87216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:14 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 Jul 09 03:23:14 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:14 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.652s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:23:14 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660" returned: 0 in 0.729s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_43bf484f-f193-410c-bcc9-5c77bd544632__tij75opdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:23:14 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 03:23:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:14 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 1G Jul 09 03:23:14 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:15 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 1G" returned: 0 in 0.663s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:15 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[413c7465-b3f2-4c6a-aa97-4af1bc7df89b]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:15 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 Jul 09 03:23:15 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:16 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660" returned: 0 in 0.766s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:16 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 Jul 09 03:23:16 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:17 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660" returned: 1 in 0.757s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Downloaded image 43bf484f-f193-410c-bcc9-5c77bd544632 ((None, [{'url': 'file:///opt/stack/data/glance/images/43bf484f-f193-410c-bcc9-5c77bd544632', 'metadata': {}}])) to volume 28179245-f1fb-494b-bfd0-601e5cdb5660 successfully. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Temporary image 43bf484f-f193-410c-bcc9-5c77bd544632 for user d05bdd3d4ef945ae9a8b0a5bef7ae316 is deleted. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Marking volume 28179245-f1fb-494b-bfd0-601e5cdb5660 as bootable. {{(pid=87216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Copying metadata from image 43bf484f-f193-410c-bcc9-5c77bd544632 to 28179245-f1fb-494b-bfd0-601e5cdb5660. {{(pid=87216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Creating volume glance metadata for volume 28179245-f1fb-494b-bfd0-601e5cdb5660 backed by image 43bf484f-f193-410c-bcc9-5c77bd544632 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '43bf484f-f193-410c-bcc9-5c77bd544632', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ffc3ec213a7c0b97fab9ee8b63724b19', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b200b9be-258e-45f5-bfeb-d8da6fb306e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28179245-f1fb-494b-bfd0-601e5cdb5660', 'volume_size': 1, 'image_id': '43bf484f-f193-410c-bcc9-5c77bd544632', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43bf484f-f193-410c-bcc9-5c77bd544632', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ffc3ec213a7c0b97fab9ee8b63724b19', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8bf0718443e497ea89d3cd1c82b0145', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '865e3df462c686ade8755f7d3341de876fce0b1522081f0ea09489028703a2fa1a43b75f560527982d92a8b3d04dd233d5d5f7bd917a29d2d0b32ed67b80322e', 'id': '43bf484f-f193-410c-bcc9-5c77bd544632', 'created_at': datetime.datetime(2026, 7, 9, 1, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 23, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43bf484f-f193-410c-bcc9-5c77bd544632/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b6c795-2687-458e-8eec-f38c6e5feae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:17 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Volume volume-28179245-f1fb-494b-bfd0-601e5cdb5660 (28179245-f1fb-494b-bfd0-601e5cdb5660): created successfully Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b6c795-2687-458e-8eec-f38c6e5feae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Flow 'volume_create_manager' (fd122b0c-1af3-4b5f-890f-7f564b3ae27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:17 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-363f934a-b1d6-49c9-9610-2a8c5704f3c1 tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Created volume successfully. Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Acquiring lock "cinder-28179245-f1fb-494b-bfd0-601e5cdb5660-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Lock "cinder-28179245-f1fb-494b-bfd0-601e5cdb5660-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Acquiring lock "cinder-quobyte-28179245-f1fb-494b-bfd0-601e5cdb5660" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Lock "cinder-quobyte-28179245-f1fb-494b-bfd0-601e5cdb5660" acquired by "delete_volume" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:18 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38a175a-7cee-4ff7-8710-ef73cb99f581]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:18 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 Jul 09 03:23:18 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:18 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660" returned: 0 in 0.727s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:18 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 Jul 09 03:23:18 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:19 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660" returned: 1 in 0.747s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:23:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:19 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660 Jul 09 03:23:19 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:20 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-28179245-f1fb-494b-bfd0-601e5cdb5660" returned: 0 in 0.634s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Lock "cinder-quobyte-28179245-f1fb-494b-bfd0-601e5cdb5660" released by "delete_volume" :: held 2.167s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:20 devstack cinder-volume[87216]: WARNING cinder.quota [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:23:20 devstack cinder-volume[87216]: WARNING cinder.quota [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Created reservations ['4f326640-276c-4ddc-b3de-c33e6bf1e2e4', 'bf893d2a-9dfa-4a3f-a1e0-a60937eebe92', 'be716a98-024e-41b0-9ae8-f8998ff121c0', 'a7445753-a3a4-433e-a010-e6cb437cd307'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:20 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:23:20 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:20 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.654s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:23:20 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Deleted volume successfully. Jul 09 03:23:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1d0b91f6-b93c-4b55-a704-9c1166124a5c tempest-VolumeAndVolumeTypeFromImageTest-1667548023 None] Lock "cinder-28179245-f1fb-494b-bfd0-601e5cdb5660-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (7539aaed-bbbe-4f33-ad44-41ab84703149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1393e953-1bbb-4471-8504-40cdb85b8e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1393e953-1bbb-4471-8504-40cdb85b8e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1603991069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e25e39-960f-40c2-9d1d-868d04c7da87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:25Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433082b9-6750-4043-90d4-2718d681b79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433082b9-6750-4043-90d4-2718d681b79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042d8ea3-d532-4500-b01e-3d750db28875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042d8ea3-d532-4500-b01e-3d750db28875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e25e39-960f-40c2-9d1d-868d04c7da87', 'volume_name': 'volume-f9e25e39-960f-40c2-9d1d-868d04c7da87', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a941017-f499-441e-bebf-7abe03b639a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a941017-f499-441e-bebf-7abe03b639a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2d1bc9-f5bf-4a38-8fbb-f2c89d58052d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:25 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume f9e25e39-960f-40c2-9d1d-868d04c7da87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e25e39-960f-40c2-9d1d-868d04c7da87', 'volume_size': 1} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1603991069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e25e39-960f-40c2-9d1d-868d04c7da87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:25Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Creating volume f9e25e39-960f-40c2-9d1d-868d04c7da87 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:23:25 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:25 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87 1073741824 Jul 09 03:23:25 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:25 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87 1073741824" returned: 0 in 0.792s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:25 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87 Jul 09 03:23:25 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:26 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87" returned: 0 in 0.622s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:23:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2d1bc9-f5bf-4a38-8fbb-f2c89d58052d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e25e39-960f-40c2-9d1d-868d04c7da87', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cafe90-66ea-46ac-8a9d-89a2950eea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:26 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume volume-f9e25e39-960f-40c2-9d1d-868d04c7da87 (f9e25e39-960f-40c2-9d1d-868d04c7da87): created successfully Jul 09 03:23:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cafe90-66ea-46ac-8a9d-89a2950eea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (7539aaed-bbbe-4f33-ad44-41ab84703149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-ed23115b-963d-4563-913f-59f1a1806241 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created volume successfully. Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (0d2f0ea1-771d-4713-86b6-8d7c09ee6457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df38d9cd-a5a9-49f7-8cf0-ee7e25754345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df38d9cd-a5a9-49f7-8cf0-ee7e25754345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1429698167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7ff6d7-12cd-4749-a987-0f98297b8b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:27Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8366957e-f743-4cde-b47f-5091e57ddcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8366957e-f743-4cde-b47f-5091e57ddcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9908d9a-f9c1-4eda-8ad7-a80335fd2b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9908d9a-f9c1-4eda-8ad7-a80335fd2b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7ff6d7-12cd-4749-a987-0f98297b8b79', 'volume_name': 'volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ad3a7d-0357-4ec2-9880-59876a3ef408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ad3a7d-0357-4ec2-9880-59876a3ef408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54e259d-8fcd-458c-bb00-3075747b11f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:27 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume ae7ff6d7-12cd-4749-a987-0f98297b8b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79', 'volume_size': 1} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1429698167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7ff6d7-12cd-4749-a987-0f98297b8b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:27Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Creating volume ae7ff6d7-12cd-4749-a987-0f98297b8b79 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:23:27 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:27 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79 1073741824 Jul 09 03:23:27 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (80bc503b-f75f-4f73-bfec-ebf144b7d9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71a9167-0dc1-4ef6-b13c-f3923eca771e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71a9167-0dc1-4ef6-b13c-f3923eca771e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1020525006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306163df-8be7-4d6b-a3c4-cd35b8e80076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:28Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cffb452-ab38-46fa-b1f3-35c313cfda08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cffb452-ab38-46fa-b1f3-35c313cfda08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdaf0e5d-e0e7-4ce8-ab0b-50aa67c8ec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdaf0e5d-e0e7-4ce8-ab0b-50aa67c8ec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306163df-8be7-4d6b-a3c4-cd35b8e80076', 'volume_name': 'volume-306163df-8be7-4d6b-a3c4-cd35b8e80076', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c9b5cf-3404-4d9f-ba18-095cc5416782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c9b5cf-3404-4d9f-ba18-095cc5416782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af480f4e-ee9c-4682-b775-22850a8b7460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:27 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume 306163df-8be7-4d6b-a3c4-cd35b8e80076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306163df-8be7-4d6b-a3c4-cd35b8e80076', 'volume_size': 1} Jul 09 03:23:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (ea06461d-74d0-4e2d-8cef-c2ac416239d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d447448-6ba8-4f2c-b2da-0144587e7880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d447448-6ba8-4f2c-b2da-0144587e7880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1090518178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a1d48c-8663-4a74-a68d-84be843a3c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:28Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51530e5-5322-4048-8096-13e384497fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51530e5-5322-4048-8096-13e384497fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601eceed-4919-46dc-a4ff-6c02aba31d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601eceed-4919-46dc-a4ff-6c02aba31d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a1d48c-8663-4a74-a68d-84be843a3c0a', 'volume_name': 'volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfcd6fa-6f16-45b8-8726-da460562c975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfcd6fa-6f16-45b8-8726-da460562c975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d296de30-2b1a-4bfc-a2b1-4e13b7f695bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:28 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume c9a1d48c-8663-4a74-a68d-84be843a3c0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a', 'volume_size': 1} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:28 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79 1073741824" returned: 0 in 0.911s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:28 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79 Jul 09 03:23:28 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (9460a288-fd7f-48c7-af33-ac8488193c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45363244-f172-4258-9a5c-0d335388fd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45363244-f172-4258-9a5c-0d335388fd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-4858648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38ac41b-4085-4dbd-a83b-ffffd765a3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:29Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375e33cb-e2f8-4733-94cc-5427edeaa9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375e33cb-e2f8-4733-94cc-5427edeaa9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642bc13c-9533-410c-99ba-949d7e86474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642bc13c-9533-410c-99ba-949d7e86474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a38ac41b-4085-4dbd-a83b-ffffd765a3c9', 'volume_name': 'volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdde913-a387-48c9-8b6e-f0f4de8f4d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdde913-a387-48c9-8b6e-f0f4de8f4d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b98e6e-bab5-46da-ad77-33f216652d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:28 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume a38ac41b-4085-4dbd-a83b-ffffd765a3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9', 'volume_size': 1} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (9b62c9d6-7042-4ce8-bd49-ef9c8b728397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3e9a90-d424-4e03-b70f-fb782b2ee968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3e9a90-d424-4e03-b70f-fb782b2ee968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302837401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd14f22-52c3-4efc-a510-6a237dad59de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:29Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad0b8e0-28a3-4adb-8654-f0e88f779c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad0b8e0-28a3-4adb-8654-f0e88f779c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6e6dba-002e-4fbf-af4d-8966af97ef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6e6dba-002e-4fbf-af4d-8966af97ef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd14f22-52c3-4efc-a510-6a237dad59de', 'volume_name': 'volume-ebd14f22-52c3-4efc-a510-6a237dad59de', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc571929-d2a3-423b-a18c-c874bc8cbcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc571929-d2a3-423b-a18c-c874bc8cbcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d2a141-30d3-4698-a9f0-8bf2a3e64456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:29 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume ebd14f22-52c3-4efc-a510-6a237dad59de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd14f22-52c3-4efc-a510-6a237dad59de', 'volume_size': 1} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:29 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79" returned: 0 in 0.672s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.260s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1020525006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306163df-8be7-4d6b-a3c4-cd35b8e80076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:28Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Creating volume 306163df-8be7-4d6b-a3c4-cd35b8e80076 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:23:29 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54e259d-8fcd-458c-bb00-3075747b11f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:29 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076 1073741824 Jul 09 03:23:29 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8933c70-a611-423d-bc12-0f116fec662e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:29 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79 (ae7ff6d7-12cd-4749-a987-0f98297b8b79): created successfully Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8933c70-a611-423d-bc12-0f116fec662e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (0d2f0ea1-771d-4713-86b6-8d7c09ee6457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:29 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-68b6e16f-07f3-42c2-90ea-7526a62251a4 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created volume successfully. Jul 09 03:23:30 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076 1073741824" returned: 0 in 0.793s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:30 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076 Jul 09 03:23:30 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:30 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076" returned: 0 in 0.629s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.336s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1090518178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a1d48c-8663-4a74-a68d-84be843a3c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:28Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Creating volume c9a1d48c-8663-4a74-a68d-84be843a3c0a {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:23:30 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:30 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a 1073741824 Jul 09 03:23:30 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af480f4e-ee9c-4682-b775-22850a8b7460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306163df-8be7-4d6b-a3c4-cd35b8e80076', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b9130a-8e29-469a-9cdd-bba43975b9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:30 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume volume-306163df-8be7-4d6b-a3c4-cd35b8e80076 (306163df-8be7-4d6b-a3c4-cd35b8e80076): created successfully Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b9130a-8e29-469a-9cdd-bba43975b9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (80bc503b-f75f-4f73-bfec-ebf144b7d9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:30 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4593ee6f-c144-4c73-aec7-8d24bcc67ea5 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created volume successfully. Jul 09 03:23:31 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a 1073741824" returned: 0 in 0.793s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:31 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a Jul 09 03:23:31 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:32 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a" returned: 0 in 0.638s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.437s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-4858648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38ac41b-4085-4dbd-a83b-ffffd765a3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:29Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Creating volume a38ac41b-4085-4dbd-a83b-ffffd765a3c9 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:23:32 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d296de30-2b1a-4bfc-a2b1-4e13b7f695bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104bfa94-f3c8-417e-a050-45a196dcb52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:32 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9 1073741824 Jul 09 03:23:32 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:32 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a (c9a1d48c-8663-4a74-a68d-84be843a3c0a): created successfully Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104bfa94-f3c8-417e-a050-45a196dcb52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (ea06461d-74d0-4e2d-8cef-c2ac416239d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7ef274de-1674-4381-ac84-c4c86465f4ed tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created volume successfully. Jul 09 03:23:32 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9 1073741824" returned: 0 in 0.785s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:33 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9 Jul 09 03:23:33 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:33 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9" returned: 0 in 0.647s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.623s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302837401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd14f22-52c3-4efc-a510-6a237dad59de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c92eeba96bb49c7b880d74a7785e948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:29Z,use_quota=True,user_id='2a0c90cf0cf5496bb55bd1ae63b0cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Creating volume ebd14f22-52c3-4efc-a510-6a237dad59de {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:23:33 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b98e6e-bab5-46da-ad77-33f216652d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:33 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de 1073741824 Jul 09 03:23:33 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad47b8f-2de3-43ca-8ff8-97727fcf8bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:33 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9 (a38ac41b-4085-4dbd-a83b-ffffd765a3c9): created successfully Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad47b8f-2de3-43ca-8ff8-97727fcf8bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (9460a288-fd7f-48c7-af33-ac8488193c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:33 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-eda2f7d8-9d4d-46c9-9cd1-f35042bf6257 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created volume successfully. Jul 09 03:23:34 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de 1073741824" returned: 0 in 0.830s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:34 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de Jul 09 03:23:34 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:35 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de" returned: 0 in 0.640s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d2a141-30d3-4698-a9f0-8bf2a3e64456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd14f22-52c3-4efc-a510-6a237dad59de', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7fe4d6-7a02-4709-a4d7-ebe4cb1109a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:35 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Volume volume-ebd14f22-52c3-4efc-a510-6a237dad59de (ebd14f22-52c3-4efc-a510-6a237dad59de): created successfully Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7fe4d6-7a02-4709-a4d7-ebe4cb1109a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Flow 'volume_create_manager' (9b62c9d6-7042-4ce8-bd49-ef9c8b728397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:35 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2bf54920-9105-41a4-9371-858031efb604 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created volume successfully. Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-ebd14f22-52c3-4efc-a510-6a237dad59de-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-ebd14f22-52c3-4efc-a510-6a237dad59de-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-quobyte-ebd14f22-52c3-4efc-a510-6a237dad59de" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-ebd14f22-52c3-4efc-a510-6a237dad59de" acquired by "delete_volume" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52596127-3beb-4517-abad-4279ab1204ee]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:35 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de Jul 09 03:23:35 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:36 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de" returned: 0 in 0.732s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:36 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de Jul 09 03:23:36 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:36 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ebd14f22-52c3-4efc-a510-6a237dad59de" returned: 0 in 0.645s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-ebd14f22-52c3-4efc-a510-6a237dad59de" released by "delete_volume" :: held 1.414s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created reservations ['cd201c77-333b-4b8e-8cba-ac054b3a9059', 'a6bba397-39a5-449e-954e-3fc501c4bec5', '4023f951-ad08-4553-854f-2dcfb091e1b6', 'd8fb8289-080b-4427-bc03-211b18876228'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:37 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:23:37 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:37 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-a38ac41b-4085-4dbd-a83b-ffffd765a3c9-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.635s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-a38ac41b-4085-4dbd-a83b-ffffd765a3c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:37 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Deleted volume successfully. Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f1ac6b7e-faa0-4f68-bf71-f5e96dcd93f3 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-ebd14f22-52c3-4efc-a510-6a237dad59de-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-quobyte-a38ac41b-4085-4dbd-a83b-ffffd765a3c9" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-a38ac41b-4085-4dbd-a83b-ffffd765a3c9" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3720db-6e72-4dfb-807a-cd69b3357e54]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:37 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9 Jul 09 03:23:37 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:38 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9" returned: 0 in 0.748s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:38 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9 Jul 09 03:23:38 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:39 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a38ac41b-4085-4dbd-a83b-ffffd765a3c9" returned: 0 in 0.630s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-a38ac41b-4085-4dbd-a83b-ffffd765a3c9" released by "delete_volume" :: held 1.415s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created reservations ['607efc08-21b6-425f-a11b-132f6f36b5c4', '7ae18064-9981-439b-b34c-e5776f96c313', '740f6d1d-b624-4e7d-8bf6-46ea035ea3b5', 'b5ca1010-6bf3-4c54-a735-ea1b7a8ab7de'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:39 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:23:39 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:39 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.617s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:23:39 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Deleted volume successfully. Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-c9a1d48c-8663-4a74-a68d-84be843a3c0a-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e6544d6-9835-47d1-b033-325d7151ad30 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-a38ac41b-4085-4dbd-a83b-ffffd765a3c9-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-c9a1d48c-8663-4a74-a68d-84be843a3c0a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-quobyte-c9a1d48c-8663-4a74-a68d-84be843a3c0a" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-c9a1d48c-8663-4a74-a68d-84be843a3c0a" acquired by "delete_volume" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:40 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[946b1f24-9c78-46dc-b052-1912f2bf5e44]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:40 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a Jul 09 03:23:40 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:40 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a" returned: 0 in 0.727s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:40 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a Jul 09 03:23:40 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:41 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c9a1d48c-8663-4a74-a68d-84be843a3c0a" returned: 0 in 0.630s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-c9a1d48c-8663-4a74-a68d-84be843a3c0a" released by "delete_volume" :: held 1.394s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:41 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created reservations ['838ec842-621a-4502-8676-17de3b4a605e', '200b4def-482f-417f-aba3-250d35e36f00', '75255389-fc16-48f3-b05a-2a98e14a8b61', '0b309161-4109-48bd-a7ec-fef119d10ffe'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:23:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:41 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:23:41 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:42 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.626s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:42 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:23:42 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Deleted volume successfully. Jul 09 03:23:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a2916c29-345c-411c-916f-b62a12adaa24 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-c9a1d48c-8663-4a74-a68d-84be843a3c0a-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-306163df-8be7-4d6b-a3c4-cd35b8e80076-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-306163df-8be7-4d6b-a3c4-cd35b8e80076-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-quobyte-306163df-8be7-4d6b-a3c4-cd35b8e80076" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-306163df-8be7-4d6b-a3c4-cd35b8e80076" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:42 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[907b9edc-886c-450f-86d1-45aeb9fd4159]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:42 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076 Jul 09 03:23:42 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:42 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076" returned: 0 in 0.726s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:43 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076 Jul 09 03:23:43 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:43 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-306163df-8be7-4d6b-a3c4-cd35b8e80076" returned: 0 in 0.641s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-306163df-8be7-4d6b-a3c4-cd35b8e80076" released by "delete_volume" :: held 1.404s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:43 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created reservations ['135e0bb8-d638-4628-adaf-0229d10fc162', '3921fb92-7bef-48c5-960d-620e66cb19e1', '01973af1-f521-472d-8165-313d48af8eba', 'd623ce51-6072-4f13-a2d3-30ab7d876144'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:23:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:43 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:23:43 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:44 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-ae7ff6d7-12cd-4749-a987-0f98297b8b79-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.636s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:44 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:23:44 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Deleted volume successfully. Jul 09 03:23:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-ae7ff6d7-12cd-4749-a987-0f98297b8b79-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9916256b-7857-439d-a659-24be59f5a342 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-306163df-8be7-4d6b-a3c4-cd35b8e80076-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-quobyte-ae7ff6d7-12cd-4749-a987-0f98297b8b79" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-ae7ff6d7-12cd-4749-a987-0f98297b8b79" acquired by "delete_volume" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:44 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2465360a-cb32-4d6a-acd3-7d1c172bf204]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:44 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79 Jul 09 03:23:44 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:45 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79" returned: 0 in 0.735s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:45 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79 Jul 09 03:23:45 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:45 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-ae7ff6d7-12cd-4749-a987-0f98297b8b79" returned: 0 in 0.647s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-ae7ff6d7-12cd-4749-a987-0f98297b8b79" released by "delete_volume" :: held 1.416s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:45 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created reservations ['2c6d50f8-634d-45c6-9dc1-a6180c61604a', '802cd107-a093-4322-b86d-4a60dcc5f2f7', '96347f1d-cc97-4c11-b5dd-ada1ddcb0e09', 'e97f68ba-d38b-43e6-ae58-f5c10dceffc0'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:23:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:46 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:23:46 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-f9e25e39-960f-40c2-9d1d-868d04c7da87-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:46 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-f9e25e39-960f-40c2-9d1d-868d04c7da87-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.665s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:46 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:23:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Deleted volume successfully. Jul 09 03:23:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3966396b-fe4b-4108-a0b1-9b095ca1f97b tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-ae7ff6d7-12cd-4749-a987-0f98297b8b79-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "cinder-quobyte-f9e25e39-960f-40c2-9d1d-868d04c7da87" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:23:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-f9e25e39-960f-40c2-9d1d-868d04c7da87" acquired by "delete_volume" :: waited 0.012s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:23:46 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a64ffc3-0ca5-40ca-aa85-16efe1d7a327]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:46 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87 Jul 09 03:23:46 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:47 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87" returned: 0 in 0.726s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:47 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87 Jul 09 03:23:47 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:48 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f9e25e39-960f-40c2-9d1d-868d04c7da87" returned: 0 in 0.639s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-quobyte-f9e25e39-960f-40c2-9d1d-868d04c7da87" released by "delete_volume" :: held 1.401s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Created reservations ['3a6cf848-c456-4488-a2ae-112d9d385fa7', '76c691cd-a52c-4372-8ede-c8c554abec17', '570e8e37-6f9a-4e44-ba6e-7037f8f81a1f', '37915669-ed8b-4dee-b699-6434709bfc6b'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:48 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:23:48 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:48 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.627s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:23:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Deleted volume successfully. Jul 09 03:23:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-51cfbb93-1715-443f-94a5-57a6a686f881 tempest-CreateVolumesFromSourceVolumeTest-2046890437 None] Lock "cinder-f9e25e39-960f-40c2-9d1d-868d04c7da87-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Flow 'volume_create_manager' (a0eab9cc-5121-4c11-b9e2-2b4744e8a1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d1c588-48f2-469e-8e2b-39579a202bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d1c588-48f2-469e-8e2b-39579a202bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f374ea-aad0-41f6-bab7-ab22465b1657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7674792086e4773a8a51ffb32c1cbea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:54Z,use_quota=True,user_id='a90b23b36ad84dd980f5804fd2c0688a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42a7655-982b-4b5f-9810-5b24b23ee10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42a7655-982b-4b5f-9810-5b24b23ee10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cbc657-2331-4877-8b35-36b3dfcf39b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.image.glance [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Creating Keystone auth plugin from conf {{(pid=87216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cbc657-2331-4877-8b35-36b3dfcf39b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '48f374ea-aad0-41f6-bab7-ab22465b1657', 'volume_name': 'volume-48f374ea-aad0-41f6-bab7-ab22465b1657', 'volume_size': 1, 'image_id': '838d7b28-904b-4df4-8aea-eac436a717c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/838d7b28-904b-4df4-8aea-eac436a717c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d54e13411e40288d79c79745cc8911e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7674792086e4773a8a51ffb32c1cbea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e06fa2afb951ced6e60e3072e5efdcd308d64b3f4529cec477aefe03f4fb133d4c7b3d2b96104234ddea2362b244baeaf1874edf20b2c098753e70dbb348a20b', 'id': '838d7b28-904b-4df4-8aea-eac436a717c9', 'created_at': datetime.datetime(2026, 7, 9, 1, 23, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 23, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/838d7b28-904b-4df4-8aea-eac436a717c9/file', 'properties': {}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec61f2e9-cf10-42dd-8c69-ac175db79fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec61f2e9-cf10-42dd-8c69-ac175db79fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a66b74c-8db3-4aa3-b7fa-76049dd6663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:23:53 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Volume 48f374ea-aad0-41f6-bab7-ab22465b1657: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-48f374ea-aad0-41f6-bab7-ab22465b1657', 'volume_size': 1, 'image_id': '838d7b28-904b-4df4-8aea-eac436a717c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/838d7b28-904b-4df4-8aea-eac436a717c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d54e13411e40288d79c79745cc8911e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7674792086e4773a8a51ffb32c1cbea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e06fa2afb951ced6e60e3072e5efdcd308d64b3f4529cec477aefe03f4fb133d4c7b3d2b96104234ddea2362b244baeaf1874edf20b2c098753e70dbb348a20b', 'id': '838d7b28-904b-4df4-8aea-eac436a717c9', 'created_at': datetime.datetime(2026, 7, 9, 1, 23, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 23, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/838d7b28-904b-4df4-8aea-eac436a717c9/file', 'properties': {}}, 'image_service': } Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Trying to clone 48f374ea-aad0-41f6-bab7-ab22465b1657 from image 838d7b28-904b-4df4-8aea-eac436a717c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/838d7b28-904b-4df4-8aea-eac436a717c9', 'metadata': {}}]). {{(pid=87216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:23:53 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Image download 0.00 MB at 0.00 MB/s Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5226ba6-b357-4543-9e64-4834d4d10b6a]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:54 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD Jul 09 03:23:54 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:54 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:54 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD Jul 09 03:23:54 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:55 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD" returned: 1 in 0.712s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:23:55 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Temporary image 838d7b28-904b-4df4-8aea-eac436a717c9 is fetched for user a90b23b36ad84dd980f5804fd2c0688a. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:23:55 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f42250-db5c-41c7-b38f-2979f7f895af]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:55 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD Jul 09 03:23:55 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:56 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:56 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD Jul 09 03:23:56 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:56 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD" returned: 1 in 0.727s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f374ea-aad0-41f6-bab7-ab22465b1657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7674792086e4773a8a51ffb32c1cbea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:23:54Z,use_quota=True,user_id='a90b23b36ad84dd980f5804fd2c0688a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Creating volume 48f374ea-aad0-41f6-bab7-ab22465b1657 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:23:56 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:23:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:56 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 1073741824 Jul 09 03:23:56 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:57 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 1073741824" returned: 0 in 0.784s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:57 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 Jul 09 03:23:57 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:58 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657" returned: 0 in 0.632s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:23:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:23:58 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Attempting download of 838d7b28-904b-4df4-8aea-eac436a717c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/838d7b28-904b-4df4-8aea-eac436a717c9', 'metadata': {}}])) to volume 48f374ea-aad0-41f6-bab7-ab22465b1657. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:23:58 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb05519-7b60-419e-be9a-6b6d9641a34a]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_838d7b28-904b-4df4-8aea-eac436a717c9_iopye6r5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:58 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_838d7b28-904b-4df4-8aea-eac436a717c9_iopye6r5 Jul 09 03:23:58 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:59 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_838d7b28-904b-4df4-8aea-eac436a717c9_iopye6r5" returned: 0 in 0.707s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_838d7b28-904b-4df4-8aea-eac436a717c9_iopye6r5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:23:59 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_838d7b28-904b-4df4-8aea-eac436a717c9_iopye6r5 Jul 09 03:23:59 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:23:59 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 09 03:23:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_838d7b28-904b-4df4-8aea-eac436a717c9_iopye6r5" returned: 1 in 0.710s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:23:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_838d7b28-904b-4df4-8aea-eac436a717c9_iopye6r5' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:23:59 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cd2262-f423-44e6-844c-8a6a5880cc40]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:23:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:00 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD Jul 09 03:24:00 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:00 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:00 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD Jul 09 03:24:00 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:01 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD" returned: 1 in 0.724s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:24:01 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] 838d7b28-904b-4df4-8aea-eac436a717c9 was raw, converting to raw {{(pid=87216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:24:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:01 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 Jul 09 03:24:01 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:02 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657" returned: 0 in 0.756s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:02 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_838d7b28-904b-4df4-8aea-eac436a717c9_97kfbeindevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:24:02 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 03:24:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:02 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 1G Jul 09 03:24:02 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:02 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 1G" returned: 0 in 0.683s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:02 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5034f8-6dd7-4d3a-8e13-3888b82038ec]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:02 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 Jul 09 03:24:02 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:03 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657" returned: 0 in 0.742s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:03 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 Jul 09 03:24:03 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:04 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657" returned: 1 in 0.751s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Downloaded image 838d7b28-904b-4df4-8aea-eac436a717c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/838d7b28-904b-4df4-8aea-eac436a717c9', 'metadata': {}}])) to volume 48f374ea-aad0-41f6-bab7-ab22465b1657 successfully. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Temporary image 838d7b28-904b-4df4-8aea-eac436a717c9 for user a90b23b36ad84dd980f5804fd2c0688a is deleted. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Marking volume 48f374ea-aad0-41f6-bab7-ab22465b1657 as bootable. {{(pid=87216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=67,cinder:UPDATE=75,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Copying metadata from image 838d7b28-904b-4df4-8aea-eac436a717c9 to 48f374ea-aad0-41f6-bab7-ab22465b1657. {{(pid=87216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Creating volume glance metadata for volume 48f374ea-aad0-41f6-bab7-ab22465b1657 backed by image 838d7b28-904b-4df4-8aea-eac436a717c9 with: {'image_id': '838d7b28-904b-4df4-8aea-eac436a717c9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0d54e13411e40288d79c79745cc8911e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=88,cinder:SELECT=50,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a66b74c-8db3-4aa3-b7fa-76049dd6663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f374ea-aad0-41f6-bab7-ab22465b1657', 'volume_size': 1, 'image_id': '838d7b28-904b-4df4-8aea-eac436a717c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/838d7b28-904b-4df4-8aea-eac436a717c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d54e13411e40288d79c79745cc8911e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7674792086e4773a8a51ffb32c1cbea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e06fa2afb951ced6e60e3072e5efdcd308d64b3f4529cec477aefe03f4fb133d4c7b3d2b96104234ddea2362b244baeaf1874edf20b2c098753e70dbb348a20b', 'id': '838d7b28-904b-4df4-8aea-eac436a717c9', 'created_at': datetime.datetime(2026, 7, 9, 1, 23, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 23, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/838d7b28-904b-4df4-8aea-eac436a717c9/file', 'properties': {}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1295352-a9b6-491b-8d6b-0be270530d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:04 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Volume volume-48f374ea-aad0-41f6-bab7-ab22465b1657 (48f374ea-aad0-41f6-bab7-ab22465b1657): created successfully Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1295352-a9b6-491b-8d6b-0be270530d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:04 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Flow 'volume_create_manager' (a0eab9cc-5121-4c11-b9e2-2b4744e8a1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:04 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-e7f57b7e-74e8-4657-8b20-6220029cea8a tempest-VolumeImageDependencyTests-1773175333 None] Created volume successfully. Jul 09 03:24:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Acquiring lock "cinder-48f374ea-aad0-41f6-bab7-ab22465b1657-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Lock "cinder-48f374ea-aad0-41f6-bab7-ab22465b1657-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Acquiring lock "cinder-quobyte-48f374ea-aad0-41f6-bab7-ab22465b1657" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Lock "cinder-quobyte-48f374ea-aad0-41f6-bab7-ab22465b1657" acquired by "delete_volume" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:05 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7687bc0c-a34b-4960-aae8-696245c0d19c]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:05 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 Jul 09 03:24:05 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:06 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657" returned: 0 in 0.732s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:06 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 Jul 09 03:24:06 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:06 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657" returned: 1 in 0.759s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:24:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:06 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657 Jul 09 03:24:06 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:07 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-48f374ea-aad0-41f6-bab7-ab22465b1657" returned: 0 in 0.627s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Lock "cinder-quobyte-48f374ea-aad0-41f6-bab7-ab22465b1657" released by "delete_volume" :: held 2.178s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:24:07 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Created reservations ['3cea308f-2d66-4c29-8231-80d521fce886', 'a88615af-1895-4f2a-a933-a0ae97db7014', '734a2cf6-5e55-4a5c-a3b8-c68f77f60688', '42d1d694-69cd-4399-959d-720985bafb27'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:24:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:07 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:24:07 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:08 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.638s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:08 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:24:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Deleted volume successfully. Jul 09 03:24:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-34a71add-13c8-43af-9c53-8ec84c05100f tempest-VolumeImageDependencyTests-1773175333 None] Lock "cinder-48f374ea-aad0-41f6-bab7-ab22465b1657-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:24:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:24:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:13 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:24:13 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:14 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.665s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:24:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:24:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:24:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:24:17 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=11,cinder:INSERT=8,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:24:18 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:INSERT=4,cinder:SELECT=7,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:24:24 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (002e171a-9a34-4182-805c-5bc211993aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060361b3-5e03-4b79-a067-2d85413efac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060361b3-5e03-4b79-a067-2d85413efac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70449345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6b0982-f040-442d-95dd-4965a517583c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:25Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef92a9c-968e-4e0f-9f63-715f165ca570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef92a9c-968e-4e0f-9f63-715f165ca570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043fae22-7b52-4010-9d65-fffd36c3289b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043fae22-7b52-4010-9d65-fffd36c3289b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6b0982-f040-442d-95dd-4965a517583c', 'volume_name': 'volume-2e6b0982-f040-442d-95dd-4965a517583c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c15083b-ceb8-43e0-80f4-6a02de0c3eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c15083b-ceb8-43e0-80f4-6a02de0c3eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489af73b-9642-47e6-bfd3-85e16ffdcaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume 2e6b0982-f040-442d-95dd-4965a517583c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6b0982-f040-442d-95dd-4965a517583c', 'volume_size': 1} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70449345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6b0982-f040-442d-95dd-4965a517583c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:25Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Creating volume 2e6b0982-f040-442d-95dd-4965a517583c {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:24:25 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:25 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c 1073741824 Jul 09 03:24:25 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Flow 'volume_create_manager' (d2666837-ac4d-4750-9634-687264c0adde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66fad2f-e886-40ff-b776-995fd227be57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66fad2f-e886-40ff-b776-995fd227be57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-477538688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c186ee0-e2cc-4fd2-835a-83ba630c5e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e369c348b6714d64b95612c22ec0d873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:25Z,use_quota=True,user_id='a693928530b44320abec0f04f511a5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780d1d9e-4885-45fa-b81e-2d12eacea0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780d1d9e-4885-45fa-b81e-2d12eacea0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d56b5e-dbb8-4491-b15c-055dd4d202ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d56b5e-dbb8-4491-b15c-055dd4d202ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c186ee0-e2cc-4fd2-835a-83ba630c5e4d', 'volume_name': 'volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2a3897-4b1e-44ba-be4f-4be7a6e714fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2a3897-4b1e-44ba-be4f-4be7a6e714fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b841ef61-7e0a-4d1d-a351-909a317799a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Volume 3c186ee0-e2cc-4fd2-835a-83ba630c5e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d', 'volume_size': 1} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Flow 'volume_create_manager' (2a4ca51f-36ea-40f2-9670-b487d97e3bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb6d3cb-e5b3-4279-873f-855067b84c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb6d3cb-e5b3-4279-873f-855067b84c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536dd2cf-09d1-4424-8dc3-6ac905ac0129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733df1e5490d484598793a76a9fc0293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:25Z,use_quota=True,user_id='79c184e2ea714787bf67a2856ad6938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fca18f4-e6af-4f73-8ab2-d5d241d9a05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fca18f4-e6af-4f73-8ab2-d5d241d9a05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c19025-918e-4676-a3f2-becbed31110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c19025-918e-4676-a3f2-becbed31110d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536dd2cf-09d1-4424-8dc3-6ac905ac0129', 'volume_name': 'volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2900679b-16e6-4949-baa4-68fc4ad6eb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2900679b-16e6-4949-baa4-68fc4ad6eb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121ce491-03f7-4078-9b17-b39fb1f68892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:25 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Volume 536dd2cf-09d1-4424-8dc3-6ac905ac0129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129', 'volume_size': 1} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:25 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c 1073741824" returned: 0 in 0.910s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:26 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c Jul 09 03:24:26 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:26 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c" returned: 0 in 0.652s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.479s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-477538688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c186ee0-e2cc-4fd2-835a-83ba630c5e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e369c348b6714d64b95612c22ec0d873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:25Z,use_quota=True,user_id='a693928530b44320abec0f04f511a5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Creating volume 3c186ee0-e2cc-4fd2-835a-83ba630c5e4d {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:24:26 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489af73b-9642-47e6-bfd3-85e16ffdcaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6b0982-f040-442d-95dd-4965a517583c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:26 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d 1073741824 Jul 09 03:24:26 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ea7a3f-3df0-4ed0-b8ef-dcb8837231c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:26 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume volume-2e6b0982-f040-442d-95dd-4965a517583c (2e6b0982-f040-442d-95dd-4965a517583c): created successfully Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ea7a3f-3df0-4ed0-b8ef-dcb8837231c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (002e171a-9a34-4182-805c-5bc211993aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-213c258a-8bca-49fe-8ed7-b7c6beda9b87 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created volume successfully. Jul 09 03:24:27 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d 1073741824" returned: 0 in 0.892s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:27 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d Jul 09 03:24:27 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:27 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Flow 'volume_create_manager' (35c0a0d2-56f1-4bee-b714-decffad5ed2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2296b735-7b7e-469d-ab6e-bd7a090ca5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2296b735-7b7e-469d-ab6e-bd7a090ca5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d555986-abfb-4677-8b1d-551b9e6e4d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f187482cec2c4abc8f757f3f85756da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:28Z,use_quota=True,user_id='1ae5a710c26446de84c958189ffe33ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3e217d3-d75e-4ea4-a9d9-d0755c6e3569),volume_type_id=f3e217d3-d75e-4ea4-a9d9-d0755c6e3569)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5121b6-3e19-4412-b580-b89872d3e24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5121b6-3e19-4412-b580-b89872d3e24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d8897d-4006-42af-b208-e02b17e747be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:27 devstack cinder-volume[87216]: DEBUG cinder.image.glance [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Creating Keystone auth plugin from conf {{(pid=87216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d8897d-4006-42af-b208-e02b17e747be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d555986-abfb-4677-8b1d-551b9e6e4d9e', 'volume_name': 'volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e', 'volume_size': 1, 'image_id': '73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44459c6febc996ce24cf098c6b640954', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f187482cec2c4abc8f757f3f85756da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '18f0481e422374987caadcea42a4072f2f23fb65a34b3f7d51f34dc9b8ae6a2af1a8893f914602206b60f3e12887003d3e5cfd28bd3b358413fda6d0c7cb1322', 'id': '73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'created_at': datetime.datetime(2026, 7, 9, 1, 24, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 24, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73ac7799-a4cc-46f4-9b5c-27aa296bb74c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de795c58-20f4-40f5-8aeb-d0edffcba434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de795c58-20f4-40f5-8aeb-d0edffcba434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc2915d-4af4-4faf-a0eb-a5bf1a9c3b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:28 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Volume 1d555986-abfb-4677-8b1d-551b9e6e4d9e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e', 'volume_size': 1, 'image_id': '73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44459c6febc996ce24cf098c6b640954', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f187482cec2c4abc8f757f3f85756da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '18f0481e422374987caadcea42a4072f2f23fb65a34b3f7d51f34dc9b8ae6a2af1a8893f914602206b60f3e12887003d3e5cfd28bd3b358413fda6d0c7cb1322', 'id': '73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'created_at': datetime.datetime(2026, 7, 9, 1, 24, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 24, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73ac7799-a4cc-46f4-9b5c-27aa296bb74c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Trying to clone 1d555986-abfb-4677-8b1d-551b9e6e4d9e from image 73ac7799-a4cc-46f4-9b5c-27aa296bb74c at location (None, [{'url': 'file:///opt/stack/data/glance/images/73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'metadata': {}}]). {{(pid=87216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:24:28 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" returned: 0 in 0.723s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.814s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536dd2cf-09d1-4424-8dc3-6ac905ac0129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733df1e5490d484598793a76a9fc0293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:25Z,use_quota=True,user_id='79c184e2ea714787bf67a2856ad6938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Creating volume 536dd2cf-09d1-4424-8dc3-6ac905ac0129 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:24:28 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b841ef61-7e0a-4d1d-a351-909a317799a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a732368c-a38e-4f2a-a63e-794b23355e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:28 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129 1073741824 Jul 09 03:24:28 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:24:28 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Image download 0.00 MB at 0.00 MB/s Jul 09 03:24:28 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Volume volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d (3c186ee0-e2cc-4fd2-835a-83ba630c5e4d): created successfully Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a732368c-a38e-4f2a-a63e-794b23355e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Flow 'volume_create_manager' (d2666837-ac4d-4750-9634-687264c0adde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:28 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-dbb93026-e1bb-4c92-b152-460454d260f6 tempest-VolumeDependencyTests-1620850098 None] Created volume successfully. Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d147f03-7e95-4460-b88f-e53e122ed2fe]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:28 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD Jul 09 03:24:28 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:29 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:29 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129 1073741824" returned: 0 in 0.879s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:29 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129 Jul 09 03:24:29 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:29 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD Jul 09 03:24:29 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:29 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129" returned: 0 in 0.645s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.788s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:29 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD" returned: 1 in 0.744s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Temporary image 73ac7799-a4cc-46f4-9b5c-27aa296bb74c is fetched for user 1ae5a710c26446de84c958189ffe33ab. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121ce491-03f7-4078-9b17-b39fb1f68892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1fa50f-00ff-4855-a711-8de6e119f4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Creating offline snapshot 66ff03b8-8302-4c18-a73c-cf6bd0d3a608 of volume 2e6b0982-f040-442d-95dd-4965a517583c {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:24:29 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Volume volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129 (536dd2cf-09d1-4424-8dc3-6ac905ac0129): created successfully Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1fa50f-00ff-4855-a711-8de6e119f4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Flow 'volume_create_manager' (2a4ca51f-36ea-40f2-9670-b487d97e3bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f795ac4-407b-4667-b205-f6dca8c9b731]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:30 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-07a4309f-3c87-4e0d-b26d-611f16a8546c tempest-CinderUnicodeTest-1705908905 None] Created volume successfully. Jul 09 03:24:30 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a6e856-e731-4e8c-8b3b-59484198ca76]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:30 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c Jul 09 03:24:30 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:30 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD Jul 09 03:24:30 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:30 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:30 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c" returned: 0 in 0.800s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:30 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 1G Jul 09 03:24:30 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:30 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD Jul 09 03:24:30 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Flow 'volume_create_manager' (c5b3a1c0-0089-4613-8a33-269432de1021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa72846-d427-4d0a-b7b6-3b1084e0b992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa72846-d427-4d0a-b7b6-3b1084e0b992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1533439400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8397555f-7839-49c0-a845-1432b51f6037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733df1e5490d484598793a76a9fc0293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:31Z,use_quota=True,user_id='79c184e2ea714787bf67a2856ad6938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46c6093-5e03-49df-aa36-b56821ad8847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46c6093-5e03-49df-aa36-b56821ad8847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6148bef-d91d-4668-8642-b806a5e05c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6148bef-d91d-4668-8642-b806a5e05c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8397555f-7839-49c0-a845-1432b51f6037', 'volume_name': 'volume-8397555f-7839-49c0-a845-1432b51f6037', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5fa318-7e72-485e-b7a0-2de1fa5ba13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5fa318-7e72-485e-b7a0-2de1fa5ba13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8baad6ee-0a34-49dc-b23d-57ca3adfa619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:31 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Volume 8397555f-7839-49c0-a845-1432b51f6037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8397555f-7839-49c0-a845-1432b51f6037', 'volume_size': 1} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:31 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD" returned: 1 in 0.797s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:31 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 1G" returned: 0 in 0.820s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6b0982-f040-442d-95dd-4965a517583c -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:31 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6b0982-f040-442d-95dd-4965a517583c -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 Jul 09 03:24:31 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:32 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6b0982-f040-442d-95dd-4965a517583c -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608" returned: 0 in 0.700s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:32 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 is being set with open permissions: ugo+rw Jul 09 03:24:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:32 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 Jul 09 03:24:32 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:32 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608" returned: 0 in 0.633s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:33 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.info Jul 09 03:24:33 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:33 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.info" returned: 0 in 0.638s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:33 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.info is being set with open permissions: ugo+rw Jul 09 03:24:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:33 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.info Jul 09 03:24:33 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:34 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.info" returned: 0 in 0.659s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.389s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.056s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] Creating offline snapshot 78c5dbf5-06bf-484c-af6b-fe45768372fb of volume 3c186ee0-e2cc-4fd2-835a-83ba630c5e4d {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:24:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-184d4aa9-c553-4feb-be8a-11ed687ab49d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Create snapshot completed successfully Jul 09 03:24:34 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc37ee11-c8f7-4dce-bc40-e291b3f90b46]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:34 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d Jul 09 03:24:34 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:35 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" returned: 0 in 0.735s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:35 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb 1G Jul 09 03:24:35 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (4dd42742-c1ea-4abc-a604-264454dafcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:35 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ecde71-2776-4655-84c3-69466e4f6272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb 1G" returned: 0 in 0.848s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ecde71-2776-4655-84c3-69466e4f6272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1795280448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fc9735-21c4-4714-9488-66390d21d30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:36Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:35 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb Jul 09 03:24:35 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60159ca-ffb9-4d76-a8c0-9bb7d6556a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60159ca-ffb9-4d76-a8c0-9bb7d6556a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762689ec-3bff-4d65-9c22-267cd944841b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762689ec-3bff-4d65-9c22-267cd944841b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3fc9735-21c4-4714-9488-66390d21d30b', 'volume_name': 'volume-c3fc9735-21c4-4714-9488-66390d21d30b', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fe6030-eadc-42c9-aa0c-304a7d25de69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fe6030-eadc-42c9-aa0c-304a7d25de69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56742ad2-1f21-495b-bd6c-46633ffb6639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:36 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume c3fc9735-21c4-4714-9488-66390d21d30b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3fc9735-21c4-4714-9488-66390d21d30b', 'volume_size': 1} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (7d1a28c8-b631-4941-a05e-548322d88105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceab5d6e-a50d-4a44-a86c-af4607ced231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceab5d6e-a50d-4a44-a86c-af4607ced231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1853014602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ca81a7-4ea7-49e0-b142-1077000b76b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:36Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e85cd31-fef1-453a-8fd4-80ebc2dc25f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e85cd31-fef1-453a-8fd4-80ebc2dc25f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3253b92-f647-45ef-85ed-0ffd2a7f21cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3253b92-f647-45ef-85ed-0ffd2a7f21cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ca81a7-4ea7-49e0-b142-1077000b76b4', 'volume_name': 'volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb281454-12f6-4fa1-b65f-77dd4acfb39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb281454-12f6-4fa1-b65f-77dd4acfb39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cfa1a8-a7bc-455d-91c1-a579964844f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:36 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume c0ca81a7-4ea7-49e0-b142-1077000b76b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4', 'volume_size': 1} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (2e383678-b39c-4055-988e-9daf52eb1819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61969f9d-b0d6-4d26-bf13-b13154add55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61969f9d-b0d6-4d26-bf13-b13154add55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-510670198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbc994d-1a15-4506-a7ce-78114af6daa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:37Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653a4373-7b89-4a4a-8017-4c935ccde42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:36 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653a4373-7b89-4a4a-8017-4c935ccde42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea978a1-d9a0-4cfa-b2cf-83a826161115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea978a1-d9a0-4cfa-b2cf-83a826161115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bbc994d-1a15-4506-a7ce-78114af6daa3', 'volume_name': 'volume-8bbc994d-1a15-4506-a7ce-78114af6daa3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86500b29-1ca7-417a-9963-8b261c989d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86500b29-1ca7-417a-9963-8b261c989d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65baa04a-6ab6-4d3a-a105-0834f779e38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:36 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume 8bbc994d-1a15-4506-a7ce-78114af6daa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bbc994d-1a15-4506-a7ce-78114af6daa3', 'volume_size': 1} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb" returned: 0 in 0.761s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:36 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb is being set with open permissions: ugo+rw Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:36 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb Jul 09 03:24:36 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (a76a1aeb-1ac9-4237-bb3f-815c61008123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:36 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b555933f-4f87-4e5d-a187-a0f2da556d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b555933f-4f87-4e5d-a187-a0f2da556d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721693336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:37Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32539995-c335-43e0-9403-7f64be053f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32539995-c335-43e0-9403-7f64be053f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51034d41-9d7c-41a9-b745-6061f506679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51034d41-9d7c-41a9-b745-6061f506679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb', 'volume_name': 'volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d911b135-2a56-4339-9cf0-392c1683222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d911b135-2a56-4339-9cf0-392c1683222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2e405c-27ef-4e1e-8975-3d27f144c14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:37 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb', 'volume_size': 1} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (b24133dc-46d9-4f85-92c1-389a0a02cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba16ec37-2e2c-44f3-82b1-a0d9df3894dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba16ec37-2e2c-44f3-82b1-a0d9df3894dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1584671366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d6ff4a-9f50-4316-ab82-571b8295308a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:37Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55eefd3e-dbfe-4a2c-aac8-e03718bba58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55eefd3e-dbfe-4a2c-aac8-e03718bba58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:37 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d2d4aa-b18e-4ee5-9360-280b998edbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d2d4aa-b18e-4ee5-9360-280b998edbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d6ff4a-9f50-4316-ab82-571b8295308a', 'volume_name': 'volume-e5d6ff4a-9f50-4316-ab82-571b8295308a', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7f7048-1755-4cdc-ac6c-7157d2675618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7f7048-1755-4cdc-ac6c-7157d2675618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c16bddf-382f-47f4-8d6b-ceb5438156f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:37 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume e5d6ff4a-9f50-4316-ab82-571b8295308a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d6ff4a-9f50-4316-ab82-571b8295308a', 'volume_size': 1} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb" returned: 0 in 0.707s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:37 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.info Jul 09 03:24:37 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:38 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.info" returned: 0 in 0.652s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:38 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.info is being set with open permissions: ugo+rw Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:38 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.info Jul 09 03:24:38 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:38 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.info" returned: 0 in 0.648s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.486s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.473s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1533439400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8397555f-7839-49c0-a845-1432b51f6037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733df1e5490d484598793a76a9fc0293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:31Z,use_quota=True,user_id='79c184e2ea714787bf67a2856ad6938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Creating volume 8397555f-7839-49c0-a845-1432b51f6037 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:24:38 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:24:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:38 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 1073741824 Jul 09 03:24:38 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-641809e0-8224-4202-bdec-0a71d35fde66 tempest-VolumeDependencyTests-1620850098 None] Create snapshot completed successfully Jul 09 03:24:39 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 1073741824" returned: 0 in 0.789s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:39 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 Jul 09 03:24:39 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Flow 'volume_create_manager' (ef504218-793f-49ca-8486-ff9e74c4fd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d20d2c6-a5fe-425a-a5a7-f5b0f288d48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d20d2c6-a5fe-425a-a5a7-f5b0f288d48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-675354554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ffad07-0817-4033-b575-e9769d0fe1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e369c348b6714d64b95612c22ec0d873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78c5dbf5-06bf-484c-af6b-fe45768372fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:40Z,use_quota=True,user_id='a693928530b44320abec0f04f511a5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbf606e-50c7-4f8c-9a2d-3bb2c4308b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbf606e-50c7-4f8c-9a2d-3bb2c4308b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767bb406-346d-4f52-a1e0-6ba8f50ad9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767bb406-346d-4f52-a1e0-6ba8f50ad9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41ffad07-0817-4033-b575-e9769d0fe1eb', 'volume_name': 'volume-41ffad07-0817-4033-b575-e9769d0fe1eb', 'volume_size': 1, 'snapshot_id': '78c5dbf5-06bf-484c-af6b-fe45768372fb'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd58846-8280-4e08-bcaa-29e2b67c5982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd58846-8280-4e08-bcaa-29e2b67c5982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6decd820-c25f-42b6-afc3-bd6464628cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:40 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Volume 41ffad07-0817-4033-b575-e9769d0fe1eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41ffad07-0817-4033-b575-e9769d0fe1eb', 'volume_size': 1, 'snapshot_id': '78c5dbf5-06bf-484c-af6b-fe45768372fb'} Jul 09 03:24:40 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037" returned: 0 in 0.645s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.713s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d555986-abfb-4677-8b1d-551b9e6e4d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f187482cec2c4abc8f757f3f85756da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:28Z,use_quota=True,user_id='1ae5a710c26446de84c958189ffe33ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3e217d3-d75e-4ea4-a9d9-d0755c6e3569),volume_type_id=f3e217d3-d75e-4ea4-a9d9-d0755c6e3569)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Creating volume 1d555986-abfb-4677-8b1d-551b9e6e4d9e {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:24:40 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8baad6ee-0a34-49dc-b23d-57ca3adfa619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8397555f-7839-49c0-a845-1432b51f6037', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:40 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e 1073741824 Jul 09 03:24:40 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b12e63a-09cd-4d1d-9034-333771d51cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:40 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Volume volume-8397555f-7839-49c0-a845-1432b51f6037 (8397555f-7839-49c0-a845-1432b51f6037): created successfully Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b12e63a-09cd-4d1d-9034-333771d51cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Flow 'volume_create_manager' (c5b3a1c0-0089-4613-8a33-269432de1021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:40 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b43d2ad2-b201-4f16-98c4-29db87f0ad62 tempest-CinderUnicodeTest-1705908905 None] Created volume successfully. Jul 09 03:24:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:41 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e 1073741824" returned: 0 in 0.839s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:41 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e Jul 09 03:24:41 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:41 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e" returned: 0 in 0.622s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.774s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1795280448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fc9735-21c4-4714-9488-66390d21d30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:36Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Creating volume c3fc9735-21c4-4714-9488-66390d21d30b {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:24:41 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:41 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b 1073741824 Jul 09 03:24:41 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Attempting download of 73ac7799-a4cc-46f4-9b5c-27aa296bb74c ((None, [{'url': 'file:///opt/stack/data/glance/images/73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'metadata': {}}])) to volume 1d555986-abfb-4677-8b1d-551b9e6e4d9e. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf368aaa-897f-40f7-8cfc-7c6bcf1e5dd1]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_j69zplj2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:41 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_j69zplj2 Jul 09 03:24:41 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:42 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:42 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_j69zplj2" returned: 0 in 0.723s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_j69zplj2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b 1073741824" returned: 0 in 0.816s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:42 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b Jul 09 03:24:42 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:42 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_j69zplj2 Jul 09 03:24:42 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:43 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b" returned: 0 in 0.668s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.021s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1853014602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ca81a7-4ea7-49e0-b142-1077000b76b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:36Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Creating volume c0ca81a7-4ea7-49e0-b142-1077000b76b4 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:43 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:24:43 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_j69zplj2" returned: 1 in 0.749s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_j69zplj2' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7945c0ad-c049-4abd-80d2-9b408c863756]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:43 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4 1073741824 Jul 09 03:24:43 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56742ad2-1f21-495b-bd6c-46633ffb6639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3fc9735-21c4-4714-9488-66390d21d30b', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff8817e-0ddf-4542-8183-b018cc8d1cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:43 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume volume-c3fc9735-21c4-4714-9488-66390d21d30b (c3fc9735-21c4-4714-9488-66390d21d30b): created successfully Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff8817e-0ddf-4542-8183-b018cc8d1cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (4dd42742-c1ea-4abc-a604-264454dafcc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3877306d-9c1a-4197-8e5a-cbd63190c7bb tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created volume successfully. Jul 09 03:24:43 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD Jul 09 03:24:43 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:44 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:44 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4 1073741824" returned: 0 in 0.853s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:44 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD Jul 09 03:24:44 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:44 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4 Jul 09 03:24:44 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:44 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD" returned: 1 in 0.712s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] 73ac7799-a4cc-46f4-9b5c-27aa296bb74c was raw, converting to raw {{(pid=87216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:44 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e Jul 09 03:24:44 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:44 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4" returned: 0 in 0.647s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.186s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-510670198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbc994d-1a15-4506-a7ce-78114af6daa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:37Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Creating volume 8bbc994d-1a15-4506-a7ce-78114af6daa3 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:24:44 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cfa1a8-a7bc-455d-91c1-a579964844f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:44 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3 1073741824 Jul 09 03:24:44 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4457cdcc-4c46-499d-910e-296d3d0bc47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:44 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4 (c0ca81a7-4ea7-49e0-b142-1077000b76b4): created successfully Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4457cdcc-4c46-499d-910e-296d3d0bc47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:44 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (7d1a28c8-b631-4941-a05e-548322d88105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:44 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-14e753a0-7a97-4aaa-a028-9f16416c60a6 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created volume successfully. Jul 09 03:24:45 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e" returned: 0 in 0.737s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:45 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_73ac7799-a4cc-46f4-9b5c-27aa296bb74c_kwr0d6btdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:24:45 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 03:24:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:45 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e 1G Jul 09 03:24:45 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:45 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3 1073741824" returned: 0 in 0.830s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:45 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3 Jul 09 03:24:45 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:46 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e 1G" returned: 0 in 0.693s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[748e7866-c49d-4bf0-b02b-ae623abadda6]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:46 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e Jul 09 03:24:46 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:46 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3" returned: 0 in 0.644s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.378s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721693336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:37Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Creating volume b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:24:46 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65baa04a-6ab6-4d3a-a105-0834f779e38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bbc994d-1a15-4506-a7ce-78114af6daa3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:46 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb 1073741824 Jul 09 03:24:46 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f643fce-e66c-4377-badd-54481c73be69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:46 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume volume-8bbc994d-1a15-4506-a7ce-78114af6daa3 (8bbc994d-1a15-4506-a7ce-78114af6daa3): created successfully Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f643fce-e66c-4377-badd-54481c73be69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (2e383678-b39c-4055-988e-9daf52eb1819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6be35197-ac25-4e95-a344-b61bd2df3b15 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created volume successfully. Jul 09 03:24:47 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e" returned: 0 in 0.760s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:47 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e Jul 09 03:24:47 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:47 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb 1073741824" returned: 0 in 0.828s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:47 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb Jul 09 03:24:47 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:47 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e" returned: 1 in 0.750s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Downloaded image 73ac7799-a4cc-46f4-9b5c-27aa296bb74c ((None, [{'url': 'file:///opt/stack/data/glance/images/73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'metadata': {}}])) to volume 1d555986-abfb-4677-8b1d-551b9e6e4d9e successfully. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Temporary image 73ac7799-a4cc-46f4-9b5c-27aa296bb74c for user 1ae5a710c26446de84c958189ffe33ab is deleted. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Marking volume 1d555986-abfb-4677-8b1d-551b9e6e4d9e as bootable. {{(pid=87216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Copying metadata from image 73ac7799-a4cc-46f4-9b5c-27aa296bb74c to 1d555986-abfb-4677-8b1d-551b9e6e4d9e. {{(pid=87216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Creating volume glance metadata for volume 1d555986-abfb-4677-8b1d-551b9e6e4d9e backed by image 73ac7799-a4cc-46f4-9b5c-27aa296bb74c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '44459c6febc996ce24cf098c6b640954', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc2915d-4af4-4faf-a0eb-a5bf1a9c3b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e', 'volume_size': 1, 'image_id': '73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44459c6febc996ce24cf098c6b640954', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f187482cec2c4abc8f757f3f85756da4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '18f0481e422374987caadcea42a4072f2f23fb65a34b3f7d51f34dc9b8ae6a2af1a8893f914602206b60f3e12887003d3e5cfd28bd3b358413fda6d0c7cb1322', 'id': '73ac7799-a4cc-46f4-9b5c-27aa296bb74c', 'created_at': datetime.datetime(2026, 7, 9, 1, 24, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 24, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73ac7799-a4cc-46f4-9b5c-27aa296bb74c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e1e7e1-61ac-4ae0-9c24-924eb66e96be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:47 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Volume volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e (1d555986-abfb-4677-8b1d-551b9e6e4d9e): created successfully Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e1e7e1-61ac-4ae0-9c24-924eb66e96be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Flow 'volume_create_manager' (35c0a0d2-56f1-4bee-b714-decffad5ed2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:47 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-81dff511-5186-44b8-9647-3406d261d04a tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Created volume successfully. Jul 09 03:24:47 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb" returned: 0 in 0.647s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.543s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1584671366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d6ff4a-9f50-4316-ab82-571b8295308a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb343bb145f54e27aaaed5fd28507dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:37Z,use_quota=True,user_id='7001be744429472ebf2610f54d33700b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Creating volume e5d6ff4a-9f50-4316-ab82-571b8295308a {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:24:47 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2e405c-27ef-4e1e-8975-3d27f144c14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:47 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a 1073741824 Jul 09 03:24:47 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:47 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dea0ebf-6e9b-4002-846b-af7033d0c703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:48 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb (b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb): created successfully Jul 09 03:24:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dea0ebf-6e9b-4002-846b-af7033d0c703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (a76a1aeb-1ac9-4237-bb3f-815c61008123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3cad2336-1aca-4832-9f57-6d802192be56 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created volume successfully. Jul 09 03:24:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Acquiring lock "cinder-1d555986-abfb-4677-8b1d-551b9e6e4d9e-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Lock "cinder-1d555986-abfb-4677-8b1d-551b9e6e4d9e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Acquiring lock "cinder-quobyte-1d555986-abfb-4677-8b1d-551b9e6e4d9e" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Lock "cinder-quobyte-1d555986-abfb-4677-8b1d-551b9e6e4d9e" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:48 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f8b51b-6edc-454a-b4c7-a3585ef92df0]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:48 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e Jul 09 03:24:48 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:48 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a 1073741824" returned: 0 in 0.860s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:48 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a Jul 09 03:24:48 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:49 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e" returned: 0 in 0.793s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:49 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e Jul 09 03:24:49 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:49 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a" returned: 0 in 0.657s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.216s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "cinder-quobyte-78c5dbf5-06bf-484c-af6b-fe45768372fb-41ffad07-0817-4033-b575-e9769d0fe1eb" by "_create_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c16bddf-382f-47f4-8d6b-ceb5438156f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d6ff4a-9f50-4316-ab82-571b8295308a', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085cf75b-614f-4a9d-a5fc-b55d139ec6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-78c5dbf5-06bf-484c-af6b-fe45768372fb-41ffad07-0817-4033-b575-e9769d0fe1eb" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Creating volume 41ffad07-0817-4033-b575-e9769d0fe1eb from snapshot 78c5dbf5-06bf-484c-af6b-fe45768372fb {{(pid=87216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "cinder-quobyte-41ffad07-0817-4033-b575-e9769d0fe1eb" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:49 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Volume volume-e5d6ff4a-9f50-4316-ab82-571b8295308a (e5d6ff4a-9f50-4316-ab82-571b8295308a): created successfully Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085cf75b-614f-4a9d-a5fc-b55d139ec6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Flow 'volume_create_manager' (b24133dc-46d9-4f85-92c1-389a0a02cc91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-41ffad07-0817-4033-b575-e9769d0fe1eb" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] snapshot: 78c5dbf5-06bf-484c-af6b-fe45768372fb, volume: 41ffad07-0817-4033-b575-e9769d0fe1eb, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:24:49 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7926699d-199f-4ec3-9821-d6afec5e4429 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created volume successfully. Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fe7d09-5106-4cd9-bd03-f0dcf641e818]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:49 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb Jul 09 03:24:49 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:49 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e" returned: 1 in 0.806s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:24:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:49 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e Jul 09 03:24:49 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-e5d6ff4a-9f50-4316-ab82-571b8295308a-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-e5d6ff4a-9f50-4316-ab82-571b8295308a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-quobyte-e5d6ff4a-9f50-4316-ab82-571b8295308a" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-e5d6ff4a-9f50-4316-ab82-571b8295308a" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0af2b69-5803-416b-a850-7d1fe09064b7]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:50 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb" returned: 0 in 0.817s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e848364-57f9-4f35-bc2c-7283e6d5d3a1]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:50 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a Jul 09 03:24:50 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:50 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1d555986-abfb-4677-8b1d-551b9e6e4d9e" returned: 0 in 0.708s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Lock "cinder-quobyte-1d555986-abfb-4677-8b1d-551b9e6e4d9e" released by "delete_volume" :: held 2.381s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Created reservations ['76960e57-d8ec-4734-b374-2b9127745fc8', '252b88cf-8f70-470a-84d6-31a19127d49b', 'a37f4ba3-26b4-4587-a355-fb0e2a3d44a3', 'c88b6e57-6e10-4775-a1fd-41ed53ff79c7'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:24:50 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d Jul 09 03:24:50 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:50 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:24:50 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:51 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a" returned: 0 in 0.785s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:51 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a Jul 09 03:24:51 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:51 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" returned: 0 in 0.857s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:51 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:51 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:24:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.692s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:51 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:24:51 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Deleted volume successfully. Jul 09 03:24:51 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb Jul 09 03:24:51 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-3e822698-3c37-433d-8005-3d482bff9d0c tempest-VolumeAndVolumeTypeFromImageTest-1623823122 None] Lock "cinder-1d555986-abfb-4677-8b1d-551b9e6e4d9e-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:24:51 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e5d6ff4a-9f50-4316-ab82-571b8295308a" returned: 0 in 0.722s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-e5d6ff4a-9f50-4316-ab82-571b8295308a" released by "delete_volume" :: held 1.554s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:24:51 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created reservations ['e402a766-f4c5-4fa3-96c5-7336c2df65fb', 'e5d15cc3-54e6-420c-89e7-8ba011edd5f6', '0e07f694-9e49-43f6-b48b-7fae6257e40d', '35d3ffcf-08b3-4386-8132-a38a578b8900'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:24:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:52 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:52 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:24:52 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-quobyte-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb" acquired by "delete_volume" :: waited 0.039s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95c42eb-c494-48da-86da-e310fbb2e3e6]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:53 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.991s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:53 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:24:53 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Deleted volume successfully. Jul 09 03:24:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c50e9b7e-944f-4a90-8f57-3dd8a4e2009b tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-e5d6ff4a-9f50-4316-ab82-571b8295308a-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:24:53 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb Jul 09 03:24:53 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:54 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb" returned: 0 in 1.570s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:54 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb Jul 09 03:24:54 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:56 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb" returned: 0 in 1.632s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb" released by "delete_volume" :: held 3.352s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:24:56 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created reservations ['3a17fc3f-1abc-4125-92ca-e62118846345', 'c5da3b21-ffc6-4726-aa7b-5b78f564c503', '31175d40-27cb-4f2c-a1dd-8483ad896afd', '0063e0be-1827-434b-a70a-d060aba68041'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:24:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:56 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:24:56 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-8bbc994d-1a15-4506-a7ce-78114af6daa3-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:57 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb" returned: 0 in 6.144s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-8bbc994d-1a15-4506-a7ce-78114af6daa3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f41088-10be-4ad3-83cb-e033a0ce3634]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-quobyte-8bbc994d-1a15-4506-a7ce-78114af6daa3" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-8bbc994d-1a15-4506-a7ce-78114af6daa3" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3029610-dbc3-4efa-a697-697bd7e117ba]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:57 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d Jul 09 03:24:57 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:57 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.092s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:24:57 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Deleted volume successfully. Jul 09 03:24:57 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3 Jul 09 03:24:57 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-94969f0c-85d5-4eaf-aafd-2821b77f971d tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-b9e6b1eb-7184-4d6d-8d1b-6a1ca62635fb-delete_volume" released by "delete_volume" :: held 4.988s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:24:58 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3" returned: 0 in 0.820s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:58 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3 Jul 09 03:24:58 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:58 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" returned: 0 in 1.024s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:58 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:24:58 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Converted 1024.00 MB image at 166.64 MB/s Jul 09 03:24:58 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb is being set with open permissions: ugo+rw Jul 09 03:24:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:58 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb Jul 09 03:24:58 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:59 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bbc994d-1a15-4506-a7ce-78114af6daa3" returned: 0 in 0.675s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-8bbc994d-1a15-4506-a7ce-78114af6daa3" released by "delete_volume" :: held 1.543s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created reservations ['48e79629-14c3-4d0d-8c7e-df2b8e43d7b2', '16f91640-b35e-40d6-b9a4-6c8b75901c89', 'b8e52b39-a596-4a14-bb50-d52946421bd2', '304e1fb4-3fd4-46cf-adbf-01396d5ac497'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:24:59 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb" returned: 0 in 0.688s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-41ffad07-0817-4033-b575-e9769d0fe1eb" released by "_copy_volume_from_snapshot" :: held 9.653s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-78c5dbf5-06bf-484c-af6b-fe45768372fb-41ffad07-0817-4033-b575-e9769d0fe1eb" released by "_create_volume_from_snapshot" :: held 9.710s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.761s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.338s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] Creating offline snapshot 93eb69d8-8cca-48f3-921c-ee88a65716f0 of volume 8397555f-7839-49c0-a845-1432b51f6037 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6decd820-c25f-42b6-afc3-bd6464628cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ffad07-0817-4033-b575-e9769d0fe1eb', 'volume_size': 1, 'snapshot_id': '78c5dbf5-06bf-484c-af6b-fe45768372fb'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248bf952-10f5-4e6a-99b9-0fdeac7f6b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8097062-495f-4df9-8e04-3e51d7a03f1c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:24:59 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Volume volume-41ffad07-0817-4033-b575-e9769d0fe1eb (41ffad07-0817-4033-b575-e9769d0fe1eb): created successfully Jul 09 03:24:59 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:24:59 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248bf952-10f5-4e6a-99b9-0fdeac7f6b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Flow 'volume_create_manager' (ef504218-793f-49ca-8486-ff9e74c4fd79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Flow 'volume_create_manager' (552a3906-bf49-42dd-90b9-87c0ed4e561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbf5a04-5f94-48ad-8e81-5d97f5f2e50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:59 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7e0f18c5-f72c-4a46-83d7-f9f87d5319ca tempest-VolumeDependencyTests-1620850098 None] Created volume successfully. Jul 09 03:24:59 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 Jul 09 03:24:59 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbf5a04-5f94-48ad-8e81-5d97f5f2e50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-942963553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fe4648-b20d-4bb9-94de-eb2c74c9a99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300da578bb0247c485a85e5e3f0f64b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:59Z,use_quota=True,user_id='bd441fc3ddf04efba9236b9a5b440632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53dd8aee-5b6a-43fe-b70d-3acca522ae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53dd8aee-5b6a-43fe-b70d-3acca522ae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef91cbfd-1a36-4f1e-9e7b-4aee72cab46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef91cbfd-1a36-4f1e-9e7b-4aee72cab46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fe4648-b20d-4bb9-94de-eb2c74c9a99c', 'volume_name': 'volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac9d162-f9fc-4c4b-814b-d897745a045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac9d162-f9fc-4c4b-814b-d897745a045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c982b6b-6a49-4c89-86ad-849ed4db09fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:24:59 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Volume a5fe4648-b20d-4bb9-94de-eb2c74c9a99c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c', 'volume_size': 1} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "cinder-78c5dbf5-06bf-484c-af6b-fe45768372fb-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-78c5dbf5-06bf-484c-af6b-fe45768372fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "cinder-quobyte-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "cinder-quobyte-78c5dbf5-06bf-484c-af6b-fe45768372fb" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-c0ca81a7-4ea7-49e0-b142-1077000b76b4-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-78c5dbf5-06bf-484c-af6b-fe45768372fb" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Deleting offline snapshot 78c5dbf5-06bf-484c-af6b-fe45768372fb of volume 3c186ee0-e2cc-4fd2-835a-83ba630c5e4d {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] snapshot_file for this snap is: volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-c0ca81a7-4ea7-49e0-b142-1077000b76b4-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47897e13-a2b3-4d6e-9e2b-e8c3cbb2cea6]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:24:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Flow 'volume_create_manager' (740cba93-8f67-4677-97df-3a9609aabd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5243000-1ec0-4bb6-bd3f-153f76e117f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-quobyte-c0ca81a7-4ea7-49e0-b142-1077000b76b4" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5243000-1ec0-4bb6-bd3f-153f76e117f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-670261545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8974a0-c019-47e3-a599-cf70c13758f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300da578bb0247c485a85e5e3f0f64b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:00Z,use_quota=True,user_id='bd441fc3ddf04efba9236b9a5b440632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042d0613-399a-4375-967e-0e2754017320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042d0613-399a-4375-967e-0e2754017320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf8e84e-92eb-48ac-9df4-85c42714fb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf8e84e-92eb-48ac-9df4-85c42714fb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe8974a0-c019-47e3-a599-cf70c13758f0', 'volume_name': 'volume-fe8974a0-c019-47e3-a599-cf70c13758f0', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cd397d-dac1-4a7f-afd7-252ffed0cd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:00 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb Jul 09 03:25:00 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cd397d-dac1-4a7f-afd7-252ffed0cd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fcbaa8-be61-475b-9988-780f724124dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:00 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Volume fe8974a0-c019-47e3-a599-cf70c13758f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe8974a0-c019-47e3-a599-cf70c13758f0', 'volume_size': 1} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-c0ca81a7-4ea7-49e0-b142-1077000b76b4" acquired by "delete_volume" :: waited 0.093s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f810f6-e92b-45d7-b554-1d199cf3b1ac]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:00 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.026s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:00 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Deleted volume successfully. Jul 09 03:25:00 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4 Jul 09 03:25:00 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f33d8f57-baec-4852-9d94-54671070c521 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-8bbc994d-1a15-4506-a7ce-78114af6daa3-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:00 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037" returned: 0 in 1.166s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:00 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 1G Jul 09 03:25:00 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Flow 'volume_create_manager' (243477a3-eea8-415f-a2e4-25d9d66a894e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c8563d-a355-404f-8a9b-b7b6fe029691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c8563d-a355-404f-8a9b-b7b6fe029691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-737856468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1961c4b-1b3a-4e20-8977-595f69215e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300da578bb0247c485a85e5e3f0f64b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:01Z,use_quota=True,user_id='bd441fc3ddf04efba9236b9a5b440632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9557b55-47db-4d63-8b8d-52424d2e9eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9557b55-47db-4d63-8b8d-52424d2e9eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff015cf-8475-4ec1-96b3-d9b041a74f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff015cf-8475-4ec1-96b3-d9b041a74f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1961c4b-1b3a-4e20-8977-595f69215e5c', 'volume_name': 'volume-a1961c4b-1b3a-4e20-8977-595f69215e5c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8587a1fc-c552-4046-8cc1-104ed33afa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8587a1fc-c552-4046-8cc1-104ed33afa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3461a6-6be5-4ce5-971a-8f7f5a72c2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:00 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Volume a1961c4b-1b3a-4e20-8977-595f69215e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1961c4b-1b3a-4e20-8977-595f69215e5c', 'volume_size': 1} Jul 09 03:25:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Flow 'volume_create_manager' (551c5714-033f-47e4-bd33-d151d6c95c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0be9f5-33de-4a81-8135-a9f5f6aa1d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:01 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0be9f5-33de-4a81-8135-a9f5f6aa1d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1395372777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79cdfda-e317-48fa-bdab-c8be089d0988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300da578bb0247c485a85e5e3f0f64b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:01Z,use_quota=True,user_id='bd441fc3ddf04efba9236b9a5b440632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69709016-8530-4ed3-a11a-0ec136575b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69709016-8530-4ed3-a11a-0ec136575b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43c7539-2fe5-4e90-b828-108a1f68d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43c7539-2fe5-4e90-b828-108a1f68d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79cdfda-e317-48fa-bdab-c8be089d0988', 'volume_name': 'volume-e79cdfda-e317-48fa-bdab-c8be089d0988', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08cf6ac-10ab-4ec6-a02b-4cd49709fe48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08cf6ac-10ab-4ec6-a02b-4cd49709fe48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12a4ac7-5029-484c-8ed8-b77b78a32f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:01 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Volume e79cdfda-e317-48fa-bdab-c8be089d0988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79cdfda-e317-48fa-bdab-c8be089d0988', 'volume_size': 1} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb" returned: 0 in 1.317s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82674f9-72b0-4472-a78c-7d3fceb67278]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:01 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4" returned: 0 in 1.166s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:01 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4 Jul 09 03:25:01 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:01 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d Jul 09 03:25:01 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Flow 'volume_create_manager' (49ecccd4-81f3-46b9-a9d2-319d34518601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ed25b6-a36a-408f-91c2-2395b42a5b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ed25b6-a36a-408f-91c2-2395b42a5b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567192784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1262b3bd-e851-4699-a951-b89c3557ef01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300da578bb0247c485a85e5e3f0f64b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:02Z,use_quota=True,user_id='bd441fc3ddf04efba9236b9a5b440632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e3069d-a760-4206-8626-14122d67fcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:01 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e3069d-a760-4206-8626-14122d67fcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0d3557-0293-4dfe-a846-3027f8dafd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0d3557-0293-4dfe-a846-3027f8dafd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1262b3bd-e851-4699-a951-b89c3557ef01', 'volume_name': 'volume-1262b3bd-e851-4699-a951-b89c3557ef01', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd3c918-ba52-4f5f-98f6-09a1dada29de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd3c918-ba52-4f5f-98f6-09a1dada29de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07534c5b-5e55-4ae8-b156-6d1f4f4650bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:01 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Volume 1262b3bd-e851-4699-a951-b89c3557ef01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1262b3bd-e851-4699-a951-b89c3557ef01', 'volume_size': 1} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 1G" returned: 0 in 1.167s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8397555f-7839-49c0-a845-1432b51f6037 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:01 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8397555f-7839-49c0-a845-1432b51f6037 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 Jul 09 03:25:01 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:02 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c0ca81a7-4ea7-49e0-b142-1077000b76b4" returned: 0 in 0.726s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-c0ca81a7-4ea7-49e0-b142-1077000b76b4" released by "delete_volume" :: held 1.948s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:02 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" returned: 0 in 0.823s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:02 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb Jul 09 03:25:02 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created reservations ['36850715-32d9-4917-aea2-0d097a3c4032', '21b902ff-9b0e-461a-8581-05e14de50302', '8dacc96c-9ad3-49ed-93ff-03f9d6f061a0', 'caac1918-8a1c-484f-b533-e0799b0463bd'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:02 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:02 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:02 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8397555f-7839-49c0-a845-1432b51f6037 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0" returned: 0 in 0.736s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:02 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 is being set with open permissions: ugo+rw Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:02 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 Jul 09 03:25:02 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:02 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb" returned: 0 in 0.781s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:02 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.657s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:02 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Deleted volume successfully. Jul 09 03:25:02 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb Jul 09 03:25:02 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-68a9f295-602c-450d-a55e-262935f8ba24 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-c0ca81a7-4ea7-49e0-b142-1077000b76b4-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:03 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0" returned: 0 in 0.701s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:03 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.info Jul 09 03:25:03 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-c3fc9735-21c4-4714-9488-66390d21d30b-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-c3fc9735-21c4-4714-9488-66390d21d30b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-quobyte-c3fc9735-21c4-4714-9488-66390d21d30b" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-c3fc9735-21c4-4714-9488-66390d21d30b" acquired by "delete_volume" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e9d843-ce30-4438-9b31-ed81534ff255]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:03 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b Jul 09 03:25:03 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:03 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d.78c5dbf5-06bf-484c-af6b-fe45768372fb" returned: 0 in 0.738s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-78c5dbf5-06bf-484c-af6b-fe45768372fb" released by "_delete_snapshot" :: held 3.808s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" released by "delete_snapshot" :: held 3.868s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Created reservations ['a21144d6-5e2a-442e-af9e-30d87ec4e4ec', '4951bd51-4482-46db-bc0e-353b71849c60', '06911e53-3624-4d63-95f8-7821e64540d6', '4faa67a7-0369-4a94-bed7-eb5d53dc379f'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:03 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Delete snapshot completed successfully. Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cef94060-62dd-4668-82e5-0d5c970f9f9b tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-78c5dbf5-06bf-484c-af6b-fe45768372fb-delete_snapshot" released by "delete_snapshot" :: held 4.059s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:03 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.info" returned: 0 in 0.740s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:03 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.info is being set with open permissions: ugo+rw Jul 09 03:25:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:03 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.info Jul 09 03:25:03 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "cinder-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "cinder-quobyte-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:04 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b" returned: 0 in 0.899s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bba8bb-0496-4026-9e44-c7f7d6e669c2]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:04 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b Jul 09 03:25:04 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:04 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d Jul 09 03:25:04 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:04 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.info" returned: 0 in 0.710s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.332s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.072s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-942963553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fe4648-b20d-4bb9-94de-eb2c74c9a99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300da578bb0247c485a85e5e3f0f64b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:24:59Z,use_quota=True,user_id='bd441fc3ddf04efba9236b9a5b440632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Creating volume a5fe4648-b20d-4bb9-94de-eb2c74c9a99c {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:04 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:04 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c 1073741824 Jul 09 03:25:04 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:04 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-e32577e4-0285-46b2-bd2e-18e53c7cc818 tempest-CinderUnicodeTest-1705908905 None] Create snapshot completed successfully Jul 09 03:25:05 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-c3fc9735-21c4-4714-9488-66390d21d30b" returned: 0 in 0.700s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-c3fc9735-21c4-4714-9488-66390d21d30b" released by "delete_volume" :: held 1.655s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created reservations ['0b051955-a235-4c3e-af1a-1f404387dbc5', '088a9dba-473f-4856-a7cd-717dc30762a5', 'ec0893ca-1ced-44f3-a226-aa83f5c658dd', '1e3bd59d-ab0a-461d-b9f2-a87289f01ce0'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:05 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" returned: 0 in 0.808s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:05 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d Jul 09 03:25:05 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:05 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:05 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "cinder-93eb69d8-8cca-48f3-921c-ee88a65716f0-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-93eb69d8-8cca-48f3-921c-ee88a65716f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "cinder-quobyte-8397555f-7839-49c0-a845-1432b51f6037" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-quobyte-8397555f-7839-49c0-a845-1432b51f6037" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "cinder-quobyte-93eb69d8-8cca-48f3-921c-ee88a65716f0" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-quobyte-93eb69d8-8cca-48f3-921c-ee88a65716f0" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Deleting offline snapshot 93eb69d8-8cca-48f3-921c-ee88a65716f0 of volume 8397555f-7839-49c0-a845-1432b51f6037 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] snapshot_file for this snap is: volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f6efee-13e7-454a-8702-81528574d1b1]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:05 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 Jul 09 03:25:05 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-66ff03b8-8302-4c18-a73c-cf6bd0d3a608-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:05 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c 1073741824" returned: 0 in 0.973s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-66ff03b8-8302-4c18-a73c-cf6bd0d3a608-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-quobyte-2e6b0982-f040-442d-95dd-4965a517583c" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-2e6b0982-f040-442d-95dd-4965a517583c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-quobyte-66ff03b8-8302-4c18-a73c-cf6bd0d3a608" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-66ff03b8-8302-4c18-a73c-cf6bd0d3a608" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Deleting offline snapshot 66ff03b8-8302-4c18-a73c-cf6bd0d3a608 of volume 2e6b0982-f040-442d-95dd-4965a517583c {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] snapshot_file for this snap is: volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b18143-dd8b-4b56-b6a2-c6c71272676d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:05 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c Jul 09 03:25:05 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:05 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 Jul 09 03:25:05 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:06 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.900s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:06 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Deleted volume successfully. Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7a3fa5ee-1bb7-4449-94e4-ed9a2fce8f95 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-c3fc9735-21c4-4714-9488-66390d21d30b-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:06 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" returned: 0 in 1.059s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d" released by "delete_volume" :: held 1.935s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:06 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0" returned: 0 in 0.924s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8397555f-7839-49c0-a845-1432b51f6037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc226f7-1048-4fcd-b4b6-999bebc45c3f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Created reservations ['91e1ddce-18b1-400b-83d5-ad0cb43ee132', '1866bfba-ee74-4ebe-bb5a-d8d55e09e782', '3b73cecc-c821-4123-9f70-84b0b25d86a8', '8e06944f-06e9-4feb-94f4-b865a076129b'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:06 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 Jul 09 03:25:06 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:06 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:06 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "cinder-41ffad07-0817-4033-b575-e9769d0fe1eb-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-41ffad07-0817-4033-b575-e9769d0fe1eb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:06 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c" returned: 0 in 0.905s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.444s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-670261545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8974a0-c019-47e3-a599-cf70c13758f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300da578bb0247c485a85e5e3f0f64b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:00Z,use_quota=True,user_id='bd441fc3ddf04efba9236b9a5b440632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Creating volume fe8974a0-c019-47e3-a599-cf70c13758f0 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:06 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:06 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0 1073741824 Jul 09 03:25:06 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c982b6b-6a49-4c89-86ad-849ed4db09fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8869c1-f672-4965-b06a-3194b312927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "cinder-quobyte-41ffad07-0817-4033-b575-e9769d0fe1eb" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-41ffad07-0817-4033-b575-e9769d0fe1eb" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:06 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Volume volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c (a5fe4648-b20d-4bb9-94de-eb2c74c9a99c): created successfully Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8869c1-f672-4965-b06a-3194b312927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Flow 'volume_create_manager' (552a3906-bf49-42dd-90b9-87c0ed4e561e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c79461e-b3eb-4ecc-ac0f-a9aad91b5d0a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:06 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3c94ae5e-18ce-4359-a446-35487fd8d2ed tempest-CreateVolumesFromImageTest-1817039759 None] Created volume successfully. Jul 09 03:25:06 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608" returned: 0 in 1.124s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e6b0982-f040-442d-95dd-4965a517583c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9156b541-35c4-4b66-8c49-f80157583765]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:06 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb Jul 09 03:25:06 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:07 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c Jul 09 03:25:07 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:07 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.969s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:07 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:07 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Deleted volume successfully. Jul 09 03:25:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4a7fbc4-a301-4ac4-a9c8-2e672de43a6d tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-3c186ee0-e2cc-4fd2-835a-83ba630c5e4d-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:07 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037" returned: 0 in 1.232s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:07 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 Jul 09 03:25:07 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:07 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb" returned: 0 in 1.068s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:07 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb Jul 09 03:25:07 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:07 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0 1073741824" returned: 0 in 1.283s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:07 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0 Jul 09 03:25:07 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:07 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c" returned: 0 in 1.068s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:08 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 Jul 09 03:25:08 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:08 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0" returned: 0 in 0.889s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:08 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0 Jul 09 03:25:08 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:08 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-41ffad07-0817-4033-b575-e9769d0fe1eb" returned: 0 in 0.800s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-quobyte-41ffad07-0817-4033-b575-e9769d0fe1eb" released by "delete_volume" :: held 1.923s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:08 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0" returned: 0 in 0.772s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.908s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-737856468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1961c4b-1b3a-4e20-8977-595f69215e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300da578bb0247c485a85e5e3f0f64b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:01Z,use_quota=True,user_id='bd441fc3ddf04efba9236b9a5b440632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Creating volume a1961c4b-1b3a-4e20-8977-595f69215e5c {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:08 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fcbaa8-be61-475b-9988-780f724124dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe8974a0-c019-47e3-a599-cf70c13758f0', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:08 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c 1073741824 Jul 09 03:25:08 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa73034c-636b-4c51-b129-2faa29392afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:08 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Volume volume-fe8974a0-c019-47e3-a599-cf70c13758f0 (fe8974a0-c019-47e3-a599-cf70c13758f0): created successfully Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa73034c-636b-4c51-b129-2faa29392afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Flow 'volume_create_manager' (740cba93-8f67-4677-97df-3a9609aabd2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Created reservations ['6385d5db-fd5f-40c6-bccb-ac9544442d60', '258e604b-30aa-4a17-84b5-83c7cc747554', 'fc1a97fa-d558-46a7-a021-3c072503725c', '6395da1f-d805-49d6-ad72-301f86fbd083'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0817223e-a370-41fe-9ba6-0e46f8f6b3f0 tempest-CreateVolumesFromImageTest-1817039759 None] Created volume successfully. Jul 09 03:25:08 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608" returned: 0 in 0.975s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:09 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608 Jul 09 03:25:09 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:09 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:09 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:09 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037.93eb69d8-8cca-48f3-921c-ee88a65716f0" returned: 0 in 1.046s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-quobyte-93eb69d8-8cca-48f3-921c-ee88a65716f0" released by "_delete_snapshot" :: held 4.241s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-quobyte-8397555f-7839-49c0-a845-1432b51f6037" released by "delete_snapshot" :: held 4.286s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Created reservations ['3bb036dd-c860-46e5-8ac1-6994f6a4722b', '44e002ab-18b5-4fe1-8c4f-53e9ec4f0b98', '741453bb-0134-4e4d-b56f-72e7579015fc', 'f548f0fa-0d44-464d-9ec7-febfaff2af15'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:09 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Delete snapshot completed successfully. Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-644a634c-a22e-463a-9307-212e6e4df62d tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-93eb69d8-8cca-48f3-921c-ee88a65716f0-delete_snapshot" released by "delete_snapshot" :: held 4.502s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:09 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c.66ff03b8-8302-4c18-a73c-cf6bd0d3a608" returned: 0 in 0.917s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:09 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-66ff03b8-8302-4c18-a73c-cf6bd0d3a608" released by "_delete_snapshot" :: held 4.209s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c 1073741824" returned: 0 in 1.203s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-2e6b0982-f040-442d-95dd-4965a517583c" released by "delete_snapshot" :: held 4.254s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:10 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c Jul 09 03:25:10 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created reservations ['277b4528-5294-4600-8e33-562a800f702b', '9de0edcb-2859-497c-bcdd-3fb5326d1bdd', 'a70373c1-9fd4-4810-a44e-35dc05f34176', '135eda8b-b302-49f6-ba7d-4d2405769712'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:10 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.014s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Deleted volume successfully. Jul 09 03:25:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Delete snapshot completed successfully. Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f83f64fe-79f1-470a-a6da-463199de4e76 tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-66ff03b8-8302-4c18-a73c-cf6bd0d3a608-delete_snapshot" released by "delete_snapshot" :: held 4.489s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2f6fdd26-acc8-4309-b791-e435cf23ded1 tempest-VolumeDependencyTests-1620850098 None] Lock "cinder-41ffad07-0817-4033-b575-e9769d0fe1eb-delete_volume" released by "delete_volume" :: held 3.571s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "cinder-8397555f-7839-49c0-a845-1432b51f6037-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-8397555f-7839-49c0-a845-1432b51f6037-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "cinder-quobyte-8397555f-7839-49c0-a845-1432b51f6037" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:10 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c" returned: 0 in 0.700s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-quobyte-8397555f-7839-49c0-a845-1432b51f6037" acquired by "delete_volume" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.452s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1395372777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79cdfda-e317-48fa-bdab-c8be089d0988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300da578bb0247c485a85e5e3f0f64b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:01Z,use_quota=True,user_id='bd441fc3ddf04efba9236b9a5b440632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Creating volume e79cdfda-e317-48fa-bdab-c8be089d0988 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:10 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daed578-4960-4fd1-824a-dbe1b512a729]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:10 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988 1073741824 Jul 09 03:25:10 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3461a6-6be5-4ce5-971a-8f7f5a72c2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1961c4b-1b3a-4e20-8977-595f69215e5c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2351ff46-c5f4-4200-961f-8fd7dcd3705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:10 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Volume volume-a1961c4b-1b3a-4e20-8977-595f69215e5c (a1961c4b-1b3a-4e20-8977-595f69215e5c): created successfully Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2351ff46-c5f4-4200-961f-8fd7dcd3705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Flow 'volume_create_manager' (243477a3-eea8-415f-a2e4-25d9d66a894e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4b7d34d9-3d97-4ec0-8ee1-d2acd586b117 tempest-CreateVolumesFromImageTest-1817039759 None] Created volume successfully. Jul 09 03:25:10 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 Jul 09 03:25:10 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-2e6b0982-f040-442d-95dd-4965a517583c-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-2e6b0982-f040-442d-95dd-4965a517583c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "cinder-quobyte-2e6b0982-f040-442d-95dd-4965a517583c" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-2e6b0982-f040-442d-95dd-4965a517583c" acquired by "delete_volume" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:11 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[41adb661-424a-4eaf-9a4d-befe77c2eb98]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:11 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c Jul 09 03:25:11 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:11 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037" returned: 0 in 1.024s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:11 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037 Jul 09 03:25:11 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:11 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988 1073741824" returned: 0 in 1.158s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:11 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988 Jul 09 03:25:11 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:12 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c" returned: 0 in 1.023s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:12 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c Jul 09 03:25:12 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:12 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8397555f-7839-49c0-a845-1432b51f6037" returned: 0 in 0.731s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-quobyte-8397555f-7839-49c0-a845-1432b51f6037" released by "delete_volume" :: held 1.849s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Created reservations ['041b2cee-a2fe-4421-ae1c-cc1c4bb9fa39', '10b35629-7b97-4145-9a70-7c30c33b8b6a', 'f6a3c4e1-4fca-4642-a3f3-60c8569780e9', 'c474e16a-5720-433e-b46e-affb6ee388b4'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:12 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:12 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:12 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988" returned: 0 in 0.852s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.123s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567192784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1262b3bd-e851-4699-a951-b89c3557ef01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300da578bb0247c485a85e5e3f0f64b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:02Z,use_quota=True,user_id='bd441fc3ddf04efba9236b9a5b440632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Creating volume 1262b3bd-e851-4699-a951-b89c3557ef01 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:12 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12a4ac7-5029-484c-8ed8-b77b78a32f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79cdfda-e317-48fa-bdab-c8be089d0988', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d53c7a9-36e2-41c0-b6dc-03f4d514fd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:12 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01 1073741824 Jul 09 03:25:12 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:12 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Volume volume-e79cdfda-e317-48fa-bdab-c8be089d0988 (e79cdfda-e317-48fa-bdab-c8be089d0988): created successfully Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d53c7a9-36e2-41c0-b6dc-03f4d514fd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Flow 'volume_create_manager' (551c5714-033f-47e4-bd33-d151d6c95c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d4944ece-f294-4a76-ae1f-de860827f345 tempest-CreateVolumesFromImageTest-1817039759 None] Created volume successfully. Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "cinder-536dd2cf-09d1-4424-8dc3-6ac905ac0129-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-536dd2cf-09d1-4424-8dc3-6ac905ac0129-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "cinder-quobyte-536dd2cf-09d1-4424-8dc3-6ac905ac0129" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-quobyte-536dd2cf-09d1-4424-8dc3-6ac905ac0129" acquired by "delete_volume" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:13 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2e6b0982-f040-442d-95dd-4965a517583c" returned: 0 in 1.052s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e97615a-b205-4423-bece-dd786d300e0a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-quobyte-2e6b0982-f040-442d-95dd-4965a517583c" released by "delete_volume" :: held 2.198s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Created reservations ['23fe7a63-47cf-413e-970b-184a8e660c1d', '15dcbd0d-8742-4313-9a44-fda65c62728a', 'f7742705-d186-4bb3-a9c1-395b9b5da783', '76665788-69fd-4eae-b596-c2aaa8474f55'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:13 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129 Jul 09 03:25:13 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:13 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:13 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:13 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.952s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Deleted volume successfully. Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2e901472-0fee-49ab-a30d-ce96e16b9f4d tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-8397555f-7839-49c0-a845-1432b51f6037-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:13 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:13 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:14 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01 1073741824" returned: 0 in 1.504s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:14 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.838s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:14 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Deleted volume successfully. Jul 09 03:25:14 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01 Jul 09 03:25:14 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c4558dfe-85f8-4539-a3f2-1528ec6d86ab tempest-CreateVolumesFromSnapshotTest-1756511104 None] Lock "cinder-2e6b0982-f040-442d-95dd-4965a517583c-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:14 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129" returned: 0 in 1.304s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:14 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129 Jul 09 03:25:14 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:14 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.043s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:25:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Flow 'volume_create_manager' (db3a7304-5337-490d-966c-22c6d3332249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:15 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd347dfd-2b56-49c1-ab11-9f0aa601eb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01" returned: 0 in 0.896s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] <== create_volume: return (2476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.480s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd347dfd-2b56-49c1-ab11-9f0aa601eb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623394134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573a97d7-24ff-4e67-9b1f-974de7b7877f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449ebacbccc4ae09595d91bd2a111a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:15Z,use_quota=True,user_id='c6c201708faf4c33be7e65fe2ab419f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e45ee0-3525-4836-ba30-6909bfcd7f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e45ee0-3525-4836-ba30-6909bfcd7f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c30ef25-5d3d-40f5-a68c-304038ce8119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c30ef25-5d3d-40f5-a68c-304038ce8119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '573a97d7-24ff-4e67-9b1f-974de7b7877f', 'volume_name': 'volume-573a97d7-24ff-4e67-9b1f-974de7b7877f', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6421603e-5fd2-430e-b08d-dde396e52497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6421603e-5fd2-430e-b08d-dde396e52497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224a72b1-aaec-4fce-b2b1-68dec382d4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:15 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Volume 573a97d7-24ff-4e67-9b1f-974de7b7877f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-573a97d7-24ff-4e67-9b1f-974de7b7877f', 'volume_size': 1} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623394134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573a97d7-24ff-4e67-9b1f-974de7b7877f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449ebacbccc4ae09595d91bd2a111a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:15Z,use_quota=True,user_id='c6c201708faf4c33be7e65fe2ab419f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Creating volume 573a97d7-24ff-4e67-9b1f-974de7b7877f {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:15 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07534c5b-5e55-4ae8-b156-6d1f4f4650bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1262b3bd-e851-4699-a951-b89c3557ef01', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681dab79-7e27-4682-891e-8630c25c667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:15 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Volume volume-1262b3bd-e851-4699-a951-b89c3557ef01 (1262b3bd-e851-4699-a951-b89c3557ef01): created successfully Jul 09 03:25:15 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f 1073741824 Jul 09 03:25:15 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681dab79-7e27-4682-891e-8630c25c667f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Flow 'volume_create_manager' (49ecccd4-81f3-46b9-a9d2-319d34518601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:15 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-00cef1e8-ca3a-463e-867a-4986365aa1f4 tempest-CreateVolumesFromImageTest-1817039759 None] Created volume successfully. Jul 09 03:25:15 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-536dd2cf-09d1-4424-8dc3-6ac905ac0129" returned: 0 in 0.870s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-quobyte-536dd2cf-09d1-4424-8dc3-6ac905ac0129" released by "delete_volume" :: held 2.253s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Created reservations ['2a01dcd6-50f4-4653-8ddb-88831bdf8d6e', 'c76c2762-866a-43f4-993f-aa1ddf4f1815', '9b0ac069-c416-4a4c-9cbd-28dcf28c3898', 'e5be1713-da5a-434c-9326-00a212cebb90'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:15 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:15 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "cinder-1262b3bd-e851-4699-a951-b89c3557ef01-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-1262b3bd-e851-4699-a951-b89c3557ef01-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "cinder-quobyte-1262b3bd-e851-4699-a951-b89c3557ef01" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:16 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f 1073741824" returned: 0 in 0.985s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-quobyte-1262b3bd-e851-4699-a951-b89c3557ef01" acquired by "delete_volume" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:16 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c56ec4b-96aa-485a-b7c8-30a78cd48151]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:16 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.802s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:16 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:16 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Deleted volume successfully. Jul 09 03:25:16 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f Jul 09 03:25:16 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-6ef0dea6-2785-4829-aade-925de7604962 tempest-CinderUnicodeTest-1705908905 None] Lock "cinder-536dd2cf-09d1-4424-8dc3-6ac905ac0129-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:16 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01 Jul 09 03:25:16 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:17 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f" returned: 0 in 0.764s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224a72b1-aaec-4fce-b2b1-68dec382d4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-573a97d7-24ff-4e67-9b1f-974de7b7877f', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cc6e62-7a3b-4b99-a9c9-74cfda5a34a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:17 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Volume volume-573a97d7-24ff-4e67-9b1f-974de7b7877f (573a97d7-24ff-4e67-9b1f-974de7b7877f): created successfully Jul 09 03:25:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cc6e62-7a3b-4b99-a9c9-74cfda5a34a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Flow 'volume_create_manager' (db3a7304-5337-490d-966c-22c6d3332249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:17 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-888d3372-4923-4e45-92e7-12bd11b47d79 tempest-ProjectReaderTests-1128884742 None] Created volume successfully. Jul 09 03:25:17 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01" returned: 0 in 0.961s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:17 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01 Jul 09 03:25:17 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:18 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1262b3bd-e851-4699-a951-b89c3557ef01" returned: 0 in 0.776s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-quobyte-1262b3bd-e851-4699-a951-b89c3557ef01" released by "delete_volume" :: held 1.789s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=161,cinder:SELECT=132,cinder:INSERT=44,cinder:DELETE=17 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (22f1ea67-154c-4325-b417-0dcd2ea59e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7676047-46df-468d-8bf0-0dfcea6e38fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7676047-46df-468d-8bf0-0dfcea6e38fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440054754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd39202-f764-41ed-88b6-5fd81ba259f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:18Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea4c93f-0fa6-4687-809c-3f51ec7b30d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea4c93f-0fa6-4687-809c-3f51ec7b30d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25460d2-b702-4c0d-b99e-1e283c81514b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25460d2-b702-4c0d-b99e-1e283c81514b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fd39202-f764-41ed-88b6-5fd81ba259f1', 'volume_name': 'volume-3fd39202-f764-41ed-88b6-5fd81ba259f1', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa42e62a-127b-412c-944c-952ff7f76d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa42e62a-127b-412c-944c-952ff7f76d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dcbdbf3-3691-4b82-aa0b-b513c92bc563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:18 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume 3fd39202-f764-41ed-88b6-5fd81ba259f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fd39202-f764-41ed-88b6-5fd81ba259f1', 'volume_size': 1} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440054754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd39202-f764-41ed-88b6-5fd81ba259f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:18Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Creating volume 3fd39202-f764-41ed-88b6-5fd81ba259f1 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:18 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=122,cinder:UPDATE=163,cinder:DELETE=14,cinder:INSERT=43 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:25:18 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1 1073741824 Jul 09 03:25:18 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Created reservations ['0957b0cc-1143-4bd2-ac1e-6e8ba11c986e', '4b287e70-db4a-4a4d-8b9d-fe0d896a6849', '05ee2a84-8e84-40e6-8aa3-0dcf3c85ceed', '7fede8da-0dc5-46b4-8877-e1b2b1c1b61c'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:18 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:18 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "cinder-e79cdfda-e317-48fa-bdab-c8be089d0988-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-e79cdfda-e317-48fa-bdab-c8be089d0988-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "cinder-quobyte-e79cdfda-e317-48fa-bdab-c8be089d0988" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-quobyte-e79cdfda-e317-48fa-bdab-c8be089d0988" acquired by "delete_volume" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd69fe0f-1dfa-4b52-b7a0-d95e240e05f2]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Acquiring lock "cinder-573a97d7-24ff-4e67-9b1f-974de7b7877f-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Lock "cinder-573a97d7-24ff-4e67-9b1f-974de7b7877f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Acquiring lock "cinder-quobyte-573a97d7-24ff-4e67-9b1f-974de7b7877f" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Lock "cinder-quobyte-573a97d7-24ff-4e67-9b1f-974de7b7877f" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc9ad3c-0472-4599-84e0-f5959756a7ca]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:18 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988 Jul 09 03:25:18 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:19 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f Jul 09 03:25:19 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:19 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1 1073741824" returned: 0 in 1.206s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:19 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.082s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:19 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:19 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Deleted volume successfully. Jul 09 03:25:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de95cc48-beef-4410-a111-e8ee976e4c4b tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-1262b3bd-e851-4699-a951-b89c3557ef01-delete_volume" released by "delete_volume" :: held 3.314s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:19 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1 Jul 09 03:25:19 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:19 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988" returned: 0 in 1.071s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:19 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988 Jul 09 03:25:19 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:20 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f" returned: 0 in 1.230s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:20 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f Jul 09 03:25:20 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:20 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1" returned: 0 in 0.876s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dcbdbf3-3691-4b82-aa0b-b513c92bc563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd39202-f764-41ed-88b6-5fd81ba259f1', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4e6102-6219-41d9-a8ef-459359d51f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:20 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume volume-3fd39202-f764-41ed-88b6-5fd81ba259f1 (3fd39202-f764-41ed-88b6-5fd81ba259f1): created successfully Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4e6102-6219-41d9-a8ef-459359d51f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (22f1ea67-154c-4325-b417-0dcd2ea59e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:20 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-3d893f00-b9ca-417f-9c4a-3151e1416067 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created volume successfully. Jul 09 03:25:20 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e79cdfda-e317-48fa-bdab-c8be089d0988" returned: 0 in 0.811s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-quobyte-e79cdfda-e317-48fa-bdab-c8be089d0988" released by "delete_volume" :: held 1.951s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Created reservations ['dfe99f6c-609d-4b93-94e7-94214f118424', '32b7982b-a8f6-4c8e-b690-53f842f0997c', '1077c297-f88a-40c2-943f-b364e0e76ae1', '0fbed734-0cbf-4a81-8c35-5f7dc1dcb2df'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:20 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:20 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:20 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "cinder-a1961c4b-1b3a-4e20-8977-595f69215e5c-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-573a97d7-24ff-4e67-9b1f-974de7b7877f" returned: 0 in 0.753s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Lock "cinder-quobyte-573a97d7-24ff-4e67-9b1f-974de7b7877f" released by "delete_volume" :: held 2.042s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-a1961c4b-1b3a-4e20-8977-595f69215e5c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "cinder-quobyte-a1961c4b-1b3a-4e20-8977-595f69215e5c" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-quobyte-a1961c4b-1b3a-4e20-8977-595f69215e5c" acquired by "delete_volume" :: waited 0.037s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Created reservations ['eab26221-fe03-429d-92a0-b1b367ca5fe7', '6aa8ba01-db64-4ca9-9007-caff7fd31c42', '46340529-5d6c-412c-a3bd-706a8717fa8f', '09765790-200d-4467-a171-42f4369a7034'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3536844-b772-4830-aa7b-926d215a057f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:21 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:21 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:21 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c Jul 09 03:25:21 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:21 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.767s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:21 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Deleted volume successfully. Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-a420043d-173f-43c8-9fed-fc07d6ec1353 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-e79cdfda-e317-48fa-bdab-c8be089d0988-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (189dd2d5-5c3c-4309-8b32-dbddebb063fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc7c785-2ce2-47bb-b0bd-60a0fb5f4daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc7c785-2ce2-47bb-b0bd-60a0fb5f4daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2030223607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e6b905-979d-4150-b479-7a83d51df775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:22Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec835b15-285d-4a5b-9a51-31abfc4088ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec835b15-285d-4a5b-9a51-31abfc4088ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4c4598-56ec-4b5c-8f32-22e2194ecacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4c4598-56ec-4b5c-8f32-22e2194ecacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e6b905-979d-4150-b479-7a83d51df775', 'volume_name': 'volume-17e6b905-979d-4150-b479-7a83d51df775', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb7cb77-e13a-4bbc-ac61-1b85ccf18666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb7cb77-e13a-4bbc-ac61-1b85ccf18666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1fc295-44ca-453e-a078-d5f1ec9fdbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:21 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume 17e6b905-979d-4150-b479-7a83d51df775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e6b905-979d-4150-b479-7a83d51df775', 'volume_size': 1} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2030223607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e6b905-979d-4150-b479-7a83d51df775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:22Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Creating volume 17e6b905-979d-4150-b479-7a83d51df775 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:21 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:22 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775 1073741824 Jul 09 03:25:22 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:22 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.944s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:22 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Deleted volume successfully. Jul 09 03:25:22 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c" returned: 0 in 1.091s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2497812a-1c04-4f7f-869f-a497b3c84b07 tempest-ProjectReaderTests-1128884742 None] Lock "cinder-573a97d7-24ff-4e67-9b1f-974de7b7877f-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:22 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c Jul 09 03:25:22 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (ff72b40b-6d26-4031-aa50-2c6b2a160a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb81564c-420f-40e7-94ac-5123cd6e9320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb81564c-420f-40e7-94ac-5123cd6e9320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2054062183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208519a3-44db-48bf-858c-2d462d3be73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:22Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d3e57c-fd75-4d39-b2f4-6ecfb3c302e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d3e57c-fd75-4d39-b2f4-6ecfb3c302e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f18a029-0356-44f9-bebf-ab151845d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f18a029-0356-44f9-bebf-ab151845d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208519a3-44db-48bf-858c-2d462d3be73b', 'volume_name': 'volume-208519a3-44db-48bf-858c-2d462d3be73b', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa54ea3-5e34-4d47-a20e-708f40b99230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa54ea3-5e34-4d47-a20e-708f40b99230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a3d1f8-f85e-4d71-a30a-e418981a85a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:22 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume 208519a3-44db-48bf-858c-2d462d3be73b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208519a3-44db-48bf-858c-2d462d3be73b', 'volume_size': 1} Jul 09 03:25:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (6d2e50ee-0aa3-4132-b4ca-41f0235ec5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b22aff4-96ce-4599-ae2e-c458faca8b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b22aff4-96ce-4599-ae2e-c458faca8b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1251262039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b5c036-740d-40e9-b5e6-0953c996c0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:23Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c76167-d02a-487f-93bb-9e0e509589e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c76167-d02a-487f-93bb-9e0e509589e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073c4e2a-9fa0-4976-b298-7a45fc6d2b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073c4e2a-9fa0-4976-b298-7a45fc6d2b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b5c036-740d-40e9-b5e6-0953c996c0a3', 'volume_name': 'volume-67b5c036-740d-40e9-b5e6-0953c996c0a3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393c6a0d-5ace-4d4c-9606-09464059f85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393c6a0d-5ace-4d4c-9606-09464059f85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756e355c-c54e-41b6-8f42-446ecdda3378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume 67b5c036-740d-40e9-b5e6-0953c996c0a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b5c036-740d-40e9-b5e6-0953c996c0a3', 'volume_size': 1} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Flow 'volume_create_manager' (8e7b753e-b00f-45f2-9784-621f12533bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7eefa2-ab50-48de-a45a-115f7f22e1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7eefa2-ab50-48de-a45a-115f7f22e1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292643662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449ebacbccc4ae09595d91bd2a111a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:23Z,use_quota=True,user_id='c6c201708faf4c33be7e65fe2ab419f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ff0214-74fe-45cf-ac32-2dd3b7b214de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ff0214-74fe-45cf-ac32-2dd3b7b214de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96547c85-4291-4d13-a593-5b5d27fad367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96547c85-4291-4d13-a593-5b5d27fad367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7', 'volume_name': 'volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb26ffc0-94ba-46cc-9a13-a0376c6cd4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb26ffc0-94ba-46cc-9a13-a0376c6cd4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ae136e-5f26-48e1-b48b-4324768dd7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Volume 1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7', 'volume_size': 1} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a1961c4b-1b3a-4e20-8977-595f69215e5c" returned: 0 in 1.313s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-quobyte-a1961c4b-1b3a-4e20-8977-595f69215e5c" released by "delete_volume" :: held 2.458s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:23 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775 1073741824" returned: 0 in 1.579s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (42aac54a-7926-4eba-9abd-e9a5ae33ee25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce779a7-f950-4872-8a59-5dcd7ce52590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce779a7-f950-4872-8a59-5dcd7ce52590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672599025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3780f387-5708-4f47-9adf-bd53704b7e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:24Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3950f7b9-140d-4bf4-ab61-6a504439e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3950f7b9-140d-4bf4-ab61-6a504439e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ad1ece-f98d-475a-b44b-98b11d43debb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ad1ece-f98d-475a-b44b-98b11d43debb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3780f387-5708-4f47-9adf-bd53704b7e95', 'volume_name': 'volume-3780f387-5708-4f47-9adf-bd53704b7e95', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc0019f-341e-40ae-921f-5a306d0e14da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc0019f-341e-40ae-921f-5a306d0e14da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9415bcf3-fadb-4874-acae-40b5f024590d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume 3780f387-5708-4f47-9adf-bd53704b7e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3780f387-5708-4f47-9adf-bd53704b7e95', 'volume_size': 1} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Created reservations ['e15a7095-817b-446f-89fc-c28a79bbfc68', '4d0f989d-36e5-45b9-be70-814268058a8e', '5e1e6fad-de52-4d83-b9a6-90e611c27c29', '624b4b9e-fddb-4117-ab45-895ef4c7ed72'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:23 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775 Jul 09 03:25:23 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (3d75e5b1-9f67-4500-9810-e15b0bbf1a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca08186-375c-475b-9169-c0c11059407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca08186-375c-475b-9169-c0c11059407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247626033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39e80b2-9a90-4d0a-a26b-b7057a3ae370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:24Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11357ff0-eedb-4813-9222-0e6bf84f3650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11357ff0-eedb-4813-9222-0e6bf84f3650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064444e9-1105-4dfa-bf3c-68944cfaecb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064444e9-1105-4dfa-bf3c-68944cfaecb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e39e80b2-9a90-4d0a-a26b-b7057a3ae370', 'volume_name': 'volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1d7f85-58dc-4505-b3de-238366ddbbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1d7f85-58dc-4505-b3de-238366ddbbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1342ec30-48cb-48b1-99a1-fd3946cf4a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:23 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume e39e80b2-9a90-4d0a-a26b-b7057a3ae370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370', 'volume_size': 1} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:23 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:23 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "cinder-fe8974a0-c019-47e3-a599-cf70c13758f0-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-fe8974a0-c019-47e3-a599-cf70c13758f0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "cinder-quobyte-fe8974a0-c019-47e3-a599-cf70c13758f0" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-quobyte-fe8974a0-c019-47e3-a599-cf70c13758f0" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:24 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775" returned: 0 in 0.804s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] <== create_volume: return (2552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.557s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2054062183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208519a3-44db-48bf-858c-2d462d3be73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:22Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Creating volume 208519a3-44db-48bf-858c-2d462d3be73b {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:24 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13d75a4-0a9c-43cf-8d16-1d57f22ee614]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:24 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b 1073741824 Jul 09 03:25:24 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1fc295-44ca-453e-a078-d5f1ec9fdbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e6b905-979d-4150-b479-7a83d51df775', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1da13f-d1d0-49ef-8758-cc131cf48bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:24 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume volume-17e6b905-979d-4150-b479-7a83d51df775 (17e6b905-979d-4150-b479-7a83d51df775): created successfully Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1da13f-d1d0-49ef-8758-cc131cf48bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (189dd2d5-5c3c-4309-8b32-dbddebb063fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:24 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a6ce293d-9be3-478d-9e3f-dbf5ed46e472 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created volume successfully. Jul 09 03:25:24 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0 Jul 09 03:25:24 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:24 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.930s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:24 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Deleted volume successfully. Jul 09 03:25:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-b5e395b4-77e2-435b-9e03-4a18d643f912 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-a1961c4b-1b3a-4e20-8977-595f69215e5c-delete_volume" released by "delete_volume" :: held 3.920s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:25 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0" returned: 0 in 0.956s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:25 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b 1073741824" returned: 0 in 0.994s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:25 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0 Jul 09 03:25:25 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:25 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b Jul 09 03:25:25 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:26 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-fe8974a0-c019-47e3-a599-cf70c13758f0" returned: 0 in 0.719s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-quobyte-fe8974a0-c019-47e3-a599-cf70c13758f0" released by "delete_volume" :: held 1.766s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Created reservations ['97f67696-3f16-4d43-9269-0acd97579358', '52329fda-60ff-4ae9-98f6-1e299f48a776', '5f22490a-2ec2-4416-9037-bfa22eb0180e', '41e72256-0c36-4468-883b-3261d475fd2c'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:26 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b" returned: 0 in 0.746s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.955s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1251262039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b5c036-740d-40e9-b5e6-0953c996c0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:23Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Creating volume 67b5c036-740d-40e9-b5e6-0953c996c0a3 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:26 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a3d1f8-f85e-4d71-a30a-e418981a85a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208519a3-44db-48bf-858c-2d462d3be73b', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:26 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3 1073741824 Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fded70c-87cc-4148-8aae-1881e3c91817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:26 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:26 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume volume-208519a3-44db-48bf-858c-2d462d3be73b (208519a3-44db-48bf-858c-2d462d3be73b): created successfully Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fded70c-87cc-4148-8aae-1881e3c91817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (ff72b40b-6d26-4031-aa50-2c6b2a160a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-255bd5b4-576e-4669-b3cf-77c4cb8a3dd2 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created volume successfully. Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:26 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:26 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "cinder-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "cinder-quobyte-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-quobyte-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7733f7-a608-4ac4-98fc-7069787ea697]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:27 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c Jul 09 03:25:27 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:27 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.935s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:27 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Deleted volume successfully. Jul 09 03:25:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1b0d8400-4ab7-4253-ad12-7a1949633285 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-fe8974a0-c019-47e3-a599-cf70c13758f0-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:27 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3 1073741824" returned: 0 in 1.215s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:27 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3 Jul 09 03:25:27 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:27 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c" returned: 0 in 1.019s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:27 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c Jul 09 03:25:27 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:28 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3" returned: 0 in 0.676s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.768s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292643662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449ebacbccc4ae09595d91bd2a111a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:23Z,use_quota=True,user_id='c6c201708faf4c33be7e65fe2ab419f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Creating volume 1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:28 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756e355c-c54e-41b6-8f42-446ecdda3378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b5c036-740d-40e9-b5e6-0953c996c0a3', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:28 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7 1073741824 Jul 09 03:25:28 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882e2043-429c-4e78-a021-d4b27ff58a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:28 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume volume-67b5c036-740d-40e9-b5e6-0953c996c0a3 (67b5c036-740d-40e9-b5e6-0953c996c0a3): created successfully Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882e2043-429c-4e78-a021-d4b27ff58a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (6d2e50ee-0aa3-4132-b4ca-41f0235ec5dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:28 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-eae69170-0215-4314-9fdb-e726e9a968ea tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created volume successfully. Jul 09 03:25:28 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c" returned: 0 in 0.660s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-quobyte-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c" released by "delete_volume" :: held 1.735s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Created reservations ['fcb135b1-a3a2-4b2e-a014-5f33c53d4f8a', '15e50864-5569-4081-a9d9-8e6811bfbf75', 'a63a6221-ab1f-4db1-8e81-5dbf4ed01937', '8fd71c30-613d-4211-8247-8af38065f902'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:28 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:28 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:29 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7 1073741824" returned: 0 in 0.983s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:29 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7 Jul 09 03:25:29 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:29 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.824s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:29 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:29 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Deleted volume successfully. Jul 09 03:25:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ae9cfce6-596a-49ae-b945-a4929f6f44d7 tempest-CreateVolumesFromImageTest-1817039759 None] Lock "cinder-a5fe4648-b20d-4bb9-94de-eb2c74c9a99c-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:30 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7" returned: 0 in 0.755s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.375s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672599025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3780f387-5708-4f47-9adf-bd53704b7e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:24Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Creating volume 3780f387-5708-4f47-9adf-bd53704b7e95 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:30 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:30 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95 1073741824 Jul 09 03:25:30 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ae136e-5f26-48e1-b48b-4324768dd7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a28f5b-f750-44bd-95a3-57ec0de44f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:30 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Volume volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7 (1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7): created successfully Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a28f5b-f750-44bd-95a3-57ec0de44f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Flow 'volume_create_manager' (8e7b753e-b00f-45f2-9784-621f12533bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:30 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-25d67776-df30-4e48-98fe-581085f773e5 tempest-ProjectReaderTests-1128884742 None] Created volume successfully. Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Acquiring lock "cinder-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Lock "cinder-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Acquiring lock "cinder-quobyte-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Lock "cinder-quobyte-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75972f4-54b2-45bb-ada4-ca510c1ccc7a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:30 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7 Jul 09 03:25:30 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:31 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95 1073741824" returned: 0 in 1.028s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:31 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95 Jul 09 03:25:31 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:31 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7" returned: 0 in 0.994s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:31 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7 Jul 09 03:25:31 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:32 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95" returned: 0 in 0.881s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.185s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247626033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39e80b2-9a90-4d0a-a26b-b7057a3ae370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9b54da9abb4bcf81b2f73ced39fbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:24Z,use_quota=True,user_id='ffdd10bbeced453ca2f80a7a0f715546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Creating volume e39e80b2-9a90-4d0a-a26b-b7057a3ae370 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:32 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:32 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370 1073741824 Jul 09 03:25:32 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9415bcf3-fadb-4874-acae-40b5f024590d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3780f387-5708-4f47-9adf-bd53704b7e95', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a113a23-5460-4058-baf7-e750fc1daf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:32 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume volume-3780f387-5708-4f47-9adf-bd53704b7e95 (3780f387-5708-4f47-9adf-bd53704b7e95): created successfully Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a113a23-5460-4058-baf7-e750fc1daf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (42aac54a-7926-4eba-9abd-e9a5ae33ee25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c72fbe96-ca3d-4511-928a-2ec338a8c249 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created volume successfully. Jul 09 03:25:32 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7" returned: 0 in 0.756s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Lock "cinder-quobyte-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7" released by "delete_volume" :: held 1.797s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Created reservations ['82291649-77da-40a9-8270-c6c4e1754251', '92b3ac90-5f62-4ab6-9a34-306898505161', '892a98b7-ea39-4cf0-9c8b-0532a0e0f928', 'f6a96af6-eb2c-4093-8cde-9617a597182f'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:32 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:32 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:33 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-dc5a2d09-8e98-4855-85eb-02bfc1efb762 tempest-ProjectAdminTests-1377902656 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6497993469238, 'free_capacity_gb': 1775.6497993469238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87216) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370 1073741824" returned: 0 in 1.013s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:33 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370 Jul 09 03:25:33 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:33 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.812s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:33 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Deleted volume successfully. Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-88133f2b-7637-492f-a156-55e35fa44d18 tempest-ProjectReaderTests-1128884742 None] Lock "cinder-1e0b7d49-8337-4565-8bbd-8fb9ab8c60f7-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:33 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370" returned: 0 in 0.712s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1342ec30-48cb-48b1-99a1-fd3946cf4a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e0d7f6-afe6-46e4-907f-d46de1549166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:33 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Volume volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370 (e39e80b2-9a90-4d0a-a26b-b7057a3ae370): created successfully Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e0d7f6-afe6-46e4-907f-d46de1549166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Flow 'volume_create_manager' (3d75e5b1-9f67-4500-9810-e15b0bbf1a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:33 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-402a173c-4b11-4c86-9b9b-fffb3444bb00 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created volume successfully. Jul 09 03:25:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-e39e80b2-9a90-4d0a-a26b-b7057a3ae370-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-e39e80b2-9a90-4d0a-a26b-b7057a3ae370-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-quobyte-e39e80b2-9a90-4d0a-a26b-b7057a3ae370" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-e39e80b2-9a90-4d0a-a26b-b7057a3ae370" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:35 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ca9f29-0278-47ce-9506-210d9a508952]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:35 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370 Jul 09 03:25:35 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:36 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370" returned: 0 in 0.960s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:36 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370 Jul 09 03:25:36 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:37 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-e39e80b2-9a90-4d0a-a26b-b7057a3ae370" returned: 0 in 0.783s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-e39e80b2-9a90-4d0a-a26b-b7057a3ae370" released by "delete_volume" :: held 1.804s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created reservations ['0bfe7da4-2510-4eba-91fe-bb23ba1b669d', 'c1afb574-0798-4e0e-a8ed-c6881d462c65', '10eae328-f319-4e62-bd7d-1609d9f3fc65', 'dc07cad0-b1d7-4c7a-aa46-4f63eda0badb'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:37 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:37 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-3780f387-5708-4f47-9adf-bd53704b7e95-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-3780f387-5708-4f47-9adf-bd53704b7e95-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-quobyte-3780f387-5708-4f47-9adf-bd53704b7e95" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-3780f387-5708-4f47-9adf-bd53704b7e95" acquired by "delete_volume" :: waited 0.034s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bf4488-ce8a-42e7-800b-5fae81622f6d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:37 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95 Jul 09 03:25:37 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:38 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.951s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:38 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Deleted volume successfully. Jul 09 03:25:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-5113d24a-d271-488a-9080-7f2210b998ad tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-e39e80b2-9a90-4d0a-a26b-b7057a3ae370-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:38 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95" returned: 0 in 1.080s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:38 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95 Jul 09 03:25:38 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:39 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3780f387-5708-4f47-9adf-bd53704b7e95" returned: 0 in 0.827s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-3780f387-5708-4f47-9adf-bd53704b7e95" released by "delete_volume" :: held 1.981s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created reservations ['a460c63e-27a2-4e12-af66-b62b7c35c847', '868b6196-d266-42f8-b26c-313eb27e4a48', '4e31f180-eff9-46ef-bc7b-8d7749e36258', '4848d3bf-ce40-4466-9c7b-e5dd045d3038'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:39 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:39 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-67b5c036-740d-40e9-b5e6-0953c996c0a3-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-67b5c036-740d-40e9-b5e6-0953c996c0a3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-quobyte-67b5c036-740d-40e9-b5e6-0953c996c0a3" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-67b5c036-740d-40e9-b5e6-0953c996c0a3" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:40 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[462aeac8-9542-4461-89cb-44a51f382838]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:40 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3 Jul 09 03:25:40 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:40 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.952s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:40 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:40 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Deleted volume successfully. Jul 09 03:25:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8d7ef747-5345-4fdb-b43d-428ea1a36b18 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-3780f387-5708-4f47-9adf-bd53704b7e95-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:41 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3" returned: 0 in 0.999s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:41 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3 Jul 09 03:25:41 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:41 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-67b5c036-740d-40e9-b5e6-0953c996c0a3" returned: 0 in 0.758s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-67b5c036-740d-40e9-b5e6-0953c996c0a3" released by "delete_volume" :: held 1.838s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:41 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created reservations ['1dadc9d2-b61f-4047-a241-06efea8b7541', 'a4211e6f-6661-4c73-9898-42ac53613941', 'e51e6907-4f83-48eb-bf1e-71f67666d3ba', 'a5077ea5-5c18-4ad7-94ea-8dc3b9288ccb'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:42 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:42 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-208519a3-44db-48bf-858c-2d462d3be73b-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-208519a3-44db-48bf-858c-2d462d3be73b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-quobyte-208519a3-44db-48bf-858c-2d462d3be73b" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-208519a3-44db-48bf-858c-2d462d3be73b" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ad021-da33-4198-a278-5c4c1f52e78d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:42 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b Jul 09 03:25:42 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:43 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.009s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:43 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Deleted volume successfully. Jul 09 03:25:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-19adb0f9-e06d-4cf3-9e61-c11330cbac6e tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-67b5c036-740d-40e9-b5e6-0953c996c0a3-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:43 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b" returned: 0 in 0.964s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:43 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b Jul 09 03:25:43 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:44 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-208519a3-44db-48bf-858c-2d462d3be73b" returned: 0 in 0.854s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-208519a3-44db-48bf-858c-2d462d3be73b" released by "delete_volume" :: held 1.870s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created reservations ['900dcf46-6a63-4b02-b42e-7c978939ef7e', 'a305525e-4b48-45a5-bd6e-2c49d3d273f1', '281cef58-415f-4943-b987-d765de928db1', '629d8fcb-e3cd-407e-bceb-196458bb2ac5'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:44 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:44 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-17e6b905-979d-4150-b479-7a83d51df775-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-17e6b905-979d-4150-b479-7a83d51df775-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-quobyte-17e6b905-979d-4150-b479-7a83d51df775" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-17e6b905-979d-4150-b479-7a83d51df775" acquired by "delete_volume" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[654b6efb-3ad7-4467-b558-caae8689a9ad]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:44 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775 Jul 09 03:25:44 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:45 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.213s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:45 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:45 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Deleted volume successfully. Jul 09 03:25:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f2653177-e4c3-4464-97e6-ca6063c0e2be tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-208519a3-44db-48bf-858c-2d462d3be73b-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:45 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775" returned: 0 in 1.053s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:45 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775 Jul 09 03:25:45 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (3ebc398a-648a-4ec6-8c5d-110a4a5d7e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee26d242-4e25-4c7f-97a8-c307ca897562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee26d242-4e25-4c7f-97a8-c307ca897562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060466709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f379cc7a-0ecb-4534-81cc-869d1baf91d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:46Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc205868-c0b8-44aa-8bdf-d255d3e38674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc205868-c0b8-44aa-8bdf-d255d3e38674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678c4bc9-2b49-4a7e-a4c4-df355f9f4a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678c4bc9-2b49-4a7e-a4c4-df355f9f4a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f379cc7a-0ecb-4534-81cc-869d1baf91d2', 'volume_name': 'volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78e2d07-a50e-427f-a6d4-24beb520d171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78e2d07-a50e-427f-a6d4-24beb520d171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ed96f5-f2ed-4b5d-9403-d13b48c1d761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:46 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Volume f379cc7a-0ecb-4534-81cc-869d1baf91d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2', 'volume_size': 1} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060466709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f379cc7a-0ecb-4534-81cc-869d1baf91d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:46Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Creating volume f379cc7a-0ecb-4534-81cc-869d1baf91d2 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:25:46 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:46 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 1073741824 Jul 09 03:25:46 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:46 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-17e6b905-979d-4150-b479-7a83d51df775" returned: 0 in 0.938s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-17e6b905-979d-4150-b479-7a83d51df775" released by "delete_volume" :: held 2.087s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created reservations ['a6ea4c3e-3154-45da-91eb-75bc526fafe9', '731c158a-019f-4772-b2f4-2e613139aa9a', '7d411f97-ab28-46bf-bec0-8663ef37ee2b', '138ccf20-4056-42c0-88fa-e7e31eabf773'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:46 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:46 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:47 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:47 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 1073741824" returned: 0 in 1.109s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.834s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:47 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:47 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Deleted volume successfully. Jul 09 03:25:47 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ebaef0df-32bd-4792-b4fe-e22bf4ad8083 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-17e6b905-979d-4150-b479-7a83d51df775-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:47 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 Jul 09 03:25:47 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-3fd39202-f764-41ed-88b6-5fd81ba259f1-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-3fd39202-f764-41ed-88b6-5fd81ba259f1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "cinder-quobyte-3fd39202-f764-41ed-88b6-5fd81ba259f1" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-3fd39202-f764-41ed-88b6-5fd81ba259f1" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[055eaaa9-cf21-4238-a060-3749cbe83c3f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:48 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1 Jul 09 03:25:48 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:48 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2" returned: 0 in 0.909s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ed96f5-f2ed-4b5d-9403-d13b48c1d761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdedd64-5f3a-443c-8f89-4e4201d79bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:48 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Volume volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 (f379cc7a-0ecb-4534-81cc-869d1baf91d2): created successfully Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdedd64-5f3a-443c-8f89-4e4201d79bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (3ebc398a-648a-4ec6-8c5d-110a4a5d7e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-236ae8c4-8fe9-4401-88ff-32e0432fe42e tempest-ProjectMemberTests-57018812 None] Created volume successfully. Jul 09 03:25:49 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1" returned: 0 in 0.899s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:49 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1 Jul 09 03:25:49 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:49 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3fd39202-f764-41ed-88b6-5fd81ba259f1" returned: 0 in 0.800s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-quobyte-3fd39202-f764-41ed-88b6-5fd81ba259f1" released by "delete_volume" :: held 1.749s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Created reservations ['0f717e82-2bc6-48ad-b664-b29e6e809599', 'e0830ffb-516d-4165-8bd5-24d54b46259f', 'f89f86f3-ad4b-45ed-933a-828c98cb87ba', '0810ca73-c257-40a1-8be5-89ca45a87c50'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:50 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:25:50 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] Creating offline snapshot e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 of volume f379cc7a-0ecb-4534-81cc-869d1baf91d2 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[87999ab1-c700-4690-a765-356f5f8ad948]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:50 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 Jul 09 03:25:50 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:50 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.835s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:50 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:25:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Deleted volume successfully. Jul 09 03:25:51 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-04e0152b-5457-44b6-a4ae-548e6ae79974 tempest-CreateVolumesFromSourceVolumeTest-1397150432 None] Lock "cinder-3fd39202-f764-41ed-88b6-5fd81ba259f1-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:25:51 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2" returned: 0 in 1.099s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:51 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 1G Jul 09 03:25:51 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:52 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 1G" returned: 0 in 1.053s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:52 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 Jul 09 03:25:52 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:53 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6" returned: 0 in 0.776s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:53 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 is being set with open permissions: ugo+rw Jul 09 03:25:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:53 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 Jul 09 03:25:53 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:54 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6" returned: 0 in 0.755s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:54 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.info Jul 09 03:25:54 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:54 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.info" returned: 0 in 0.687s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:54 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.info is being set with open permissions: ugo+rw Jul 09 03:25:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:55 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.info Jul 09 03:25:55 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:55 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.info" returned: 0 in 0.727s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.231s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:25:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5588f989-aefb-4695-bfac-bd552413fe10 tempest-ProjectMemberTests-57018812 None] Create snapshot completed successfully Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Lock "cinder-e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-f379cc7a-0ecb-4534-81cc-869d1baf91d2" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-f379cc7a-0ecb-4534-81cc-869d1baf91d2" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Deleting offline snapshot e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 of volume f379cc7a-0ecb-4534-81cc-869d1baf91d2 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] snapshot_file for this snap is: volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Flow 'volume_create_manager' (0b55d812-a968-40b6-8bf6-7424c78cb742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccf56d2-9874-4cbf-a383-34631ab05b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf77894-89c3-4381-a8f6-f9be3f68801b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccf56d2-9874-4cbf-a383-34631ab05b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836e0d74-1bfe-4768-ad66-828067059b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35abb971ff0b4cd590faf3d1da6b0105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:57Z,use_quota=True,user_id='3a66a6ebaa3646f689eb5df833a44cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb71242-ffa6-4e6d-8712-dfe5e5cb3cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb71242-ffa6-4e6d-8712-dfe5e5cb3cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83653df-a398-4255-9c58-6861fe4b26e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:56 devstack cinder-volume[87216]: DEBUG cinder.image.glance [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Creating Keystone auth plugin from conf {{(pid=87216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:25:56 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 Jul 09 03:25:56 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83653df-a398-4255-9c58-6861fe4b26e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '836e0d74-1bfe-4768-ad66-828067059b68', 'volume_name': 'volume-836e0d74-1bfe-4768-ad66-828067059b68', 'volume_size': 1, 'image_id': '1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7443b11437a668c2dfe2907fa8e601e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35abb971ff0b4cd590faf3d1da6b0105', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6943bc7651e242f377e44bdac0eb2cc3fb76d2f265c6926919f685bf702493c65808e9ab9daaa08aa18671f03371c1afeb8800f0802f40c9f0c8d195eab644b', 'id': '1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'created_at': datetime.datetime(2026, 7, 9, 1, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ec1ff40-aecb-43eb-ad70-8ea088c1a910/file', 'properties': {}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a065363-f578-45d0-8782-dbecbf74a63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a065363-f578-45d0-8782-dbecbf74a63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4240ad02-0e33-4ee3-bd36-9dc40d17ce00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:25:57 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Volume 836e0d74-1bfe-4768-ad66-828067059b68: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-836e0d74-1bfe-4768-ad66-828067059b68', 'volume_size': 1, 'image_id': '1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7443b11437a668c2dfe2907fa8e601e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35abb971ff0b4cd590faf3d1da6b0105', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6943bc7651e242f377e44bdac0eb2cc3fb76d2f265c6926919f685bf702493c65808e9ab9daaa08aa18671f03371c1afeb8800f0802f40c9f0c8d195eab644b', 'id': '1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'created_at': datetime.datetime(2026, 7, 9, 1, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ec1ff40-aecb-43eb-ad70-8ea088c1a910/file', 'properties': {}}, 'image_service': } Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Trying to clone 836e0d74-1bfe-4768-ad66-828067059b68 from image 1ec1ff40-aecb-43eb-ad70-8ea088c1a910 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'metadata': {}}]). {{(pid=87216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:25:57 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Image download 0.00 MB at 0.00 MB/s Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bffc8b-057b-42dd-a49b-466d8b572345]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:57 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD Jul 09 03:25:57 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:57 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6" returned: 0 in 0.794s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d055a70-4548-4d69-bb58-abdad744dc87]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:57 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 Jul 09 03:25:57 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:58 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD" returned: 0 in 0.784s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:58 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD Jul 09 03:25:58 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:58 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2" returned: 0 in 0.817s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:58 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 Jul 09 03:25:58 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:58 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD" returned: 1 in 0.788s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:25:58 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Temporary image 1ec1ff40-aecb-43eb-ad70-8ea088c1a910 is fetched for user 3a66a6ebaa3646f689eb5df833a44cc9. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:25:58 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdf99c5-855c-4854-afc4-df3fbef6e4ff]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:25:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:59 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD Jul 09 03:25:59 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:59 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6" returned: 0 in 0.799s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:59 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6 Jul 09 03:25:59 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:59 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD" returned: 0 in 0.788s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:25:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:25:59 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD Jul 09 03:25:59 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:25:59 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jul 09 03:25:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2.e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6" returned: 0 in 0.725s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6" released by "_delete_snapshot" :: held 3.306s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-f379cc7a-0ecb-4534-81cc-869d1baf91d2" released by "delete_snapshot" :: held 3.336s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Created reservations ['cf9a78ec-234e-4a0b-a774-82efadfb6a7c', 'fd3e67cc-6a76-4643-89ad-88b314b55198', '18258fce-affd-45ac-98a5-4874de6ebfcc', 'a6e0581b-ebfd-4bdc-805c-0ca594dd495e'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:00 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Delete snapshot completed successfully. Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-582a607a-29a6-4fd0-8746-9f82c6f97634 tempest-ProjectMemberTests-57018812 None] Lock "cinder-e7e7d8f6-0921-4d0e-8211-ecd9c90bd4a6-delete_snapshot" released by "delete_snapshot" :: held 3.525s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:00 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD" returned: 1 in 0.897s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836e0d74-1bfe-4768-ad66-828067059b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35abb971ff0b4cd590faf3d1da6b0105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:25:57Z,use_quota=True,user_id='3a66a6ebaa3646f689eb5df833a44cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Creating volume 836e0d74-1bfe-4768-ad66-828067059b68 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:26:00 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:00 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 1073741824 Jul 09 03:26:00 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-f379cc7a-0ecb-4534-81cc-869d1baf91d2-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Lock "cinder-f379cc7a-0ecb-4534-81cc-869d1baf91d2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-f379cc7a-0ecb-4534-81cc-869d1baf91d2" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-f379cc7a-0ecb-4534-81cc-869d1baf91d2" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:01 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f0e0ed-682b-41cf-8ea6-a9a75001114a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:01 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 Jul 09 03:26:01 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:01 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 1073741824" returned: 0 in 0.948s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:01 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 Jul 09 03:26:01 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:01 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2" returned: 0 in 0.829s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:01 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2 Jul 09 03:26:01 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:02 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68" returned: 0 in 0.730s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Attempting download of 1ec1ff40-aecb-43eb-ad70-8ea088c1a910 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'metadata': {}}])) to volume 836e0d74-1bfe-4768-ad66-828067059b68. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[503e0e98-8d78-40b3-be41-202bf49aefd4]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_v2lpmoeb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:02 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_v2lpmoeb Jul 09 03:26:02 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:02 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f379cc7a-0ecb-4534-81cc-869d1baf91d2" returned: 0 in 0.782s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-f379cc7a-0ecb-4534-81cc-869d1baf91d2" released by "delete_volume" :: held 1.673s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Created reservations ['84bb19af-47c6-4c35-858c-bdc101c7a250', 'a253576d-dec1-4e10-a792-754a2c20ff92', 'ab9c4240-ceac-4530-83da-64b2730fabab', 'd8f98daa-144f-424c-8ac9-9073931eceb7'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:02 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:26:02 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:03 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_v2lpmoeb" returned: 0 in 0.834s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_v2lpmoeb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:03 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_v2lpmoeb Jul 09 03:26:03 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:03 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.808s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:26:03 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Deleted volume successfully. Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-028121fe-32b0-4cde-9e33-707a10a907dc tempest-ProjectMemberTests-57018812 None] Lock "cinder-f379cc7a-0ecb-4534-81cc-869d1baf91d2-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (529dfd93-1467-45ce-adf8-72d14a09199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ec53af-28fb-4793-9001-1d24d17dbeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ec53af-28fb-4793-9001-1d24d17dbeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424395434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11de47c0-32a5-4c6c-ac04-932cfb73348c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:04Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9678d0-b46a-4595-8ef9-822b40d2b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9678d0-b46a-4595-8ef9-822b40d2b977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0e0ff2-14f0-4e00-90c3-d9b16e9ca073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0e0ff2-14f0-4e00-90c3-d9b16e9ca073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11de47c0-32a5-4c6c-ac04-932cfb73348c', 'volume_name': 'volume-11de47c0-32a5-4c6c-ac04-932cfb73348c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73df6d52-1c6d-4f42-af09-ef2b7c2651ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73df6d52-1c6d-4f42-af09-ef2b7c2651ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3720e3d2-fee9-4dd7-9c59-ab7cb024e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:03 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Volume 11de47c0-32a5-4c6c-ac04-932cfb73348c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11de47c0-32a5-4c6c-ac04-932cfb73348c', 'volume_size': 1} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424395434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11de47c0-32a5-4c6c-ac04-932cfb73348c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:04Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Creating volume 11de47c0-32a5-4c6c-ac04-932cfb73348c {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:26:03 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:26:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:03 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c 1073741824 Jul 09 03:26:03 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:04 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_v2lpmoeb" returned: 1 in 0.937s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_v2lpmoeb' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:26:04 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d2d3c5-7845-48af-be04-eb3cc1380ddc]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:04 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD Jul 09 03:26:04 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:04 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c 1073741824" returned: 0 in 0.983s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:04 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c Jul 09 03:26:04 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:05 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD" returned: 0 in 0.840s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:05 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD Jul 09 03:26:05 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:05 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c" returned: 0 in 0.826s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3720e3d2-fee9-4dd7-9c59-ab7cb024e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11de47c0-32a5-4c6c-ac04-932cfb73348c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995b8221-e84d-4d5b-ada3-cc27504aba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:05 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Volume volume-11de47c0-32a5-4c6c-ac04-932cfb73348c (11de47c0-32a5-4c6c-ac04-932cfb73348c): created successfully Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995b8221-e84d-4d5b-ada3-cc27504aba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (529dfd93-1467-45ce-adf8-72d14a09199d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:05 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-af153f25-e676-4997-87dc-07b3ab958d98 tempest-ProjectMemberTests-57018812 None] Created volume successfully. Jul 09 03:26:05 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD" returned: 1 in 0.884s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] 1ec1ff40-aecb-43eb-ad70-8ea088c1a910 was raw, converting to raw {{(pid=87216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:26:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:06 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 Jul 09 03:26:06 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Flow 'volume_create_manager' (fd079182-3e42-4289-af39-a8f2c1eec506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21a6661-5db1-4492-bd15-740e0ae9b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:06 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68" returned: 0 in 0.757s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ec1ff40-aecb-43eb-ad70-8ea088c1a910_ae0287v1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:26:06 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21a6661-5db1-4492-bd15-740e0ae9b355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1784023752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1134e5e0-9d84-4584-a240-5efda47eb0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ba014154504a80893095c333470d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:07Z,use_quota=True,user_id='655ae464f57e454892d9239b1601d5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:06 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 1G Jul 09 03:26:06 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f88e0f-fc6d-4fb5-872e-f0471e8d94a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f88e0f-fc6d-4fb5-872e-f0471e8d94a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46eaaeb0-0ded-4814-ad1c-2e242ff83301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46eaaeb0-0ded-4814-ad1c-2e242ff83301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1134e5e0-9d84-4584-a240-5efda47eb0c8', 'volume_name': 'volume-1134e5e0-9d84-4584-a240-5efda47eb0c8', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcbdec2-7926-41d2-aaae-3a89b9f30d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcbdec2-7926-41d2-aaae-3a89b9f30d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9143df-2d87-4f4f-93bc-f8588ce6940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:06 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Volume 1134e5e0-9d84-4584-a240-5efda47eb0c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1134e5e0-9d84-4584-a240-5efda47eb0c8', 'volume_size': 1} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1784023752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1134e5e0-9d84-4584-a240-5efda47eb0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ba014154504a80893095c333470d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:07Z,use_quota=True,user_id='655ae464f57e454892d9239b1601d5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Creating volume 1134e5e0-9d84-4584-a240-5efda47eb0c8 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:26:06 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:26:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:06 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 1073741824 Jul 09 03:26:06 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:07 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 1G" returned: 0 in 0.756s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:07 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4473f34-753f-4f19-b5c4-e382f6d8a022]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:07 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 Jul 09 03:26:07 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:07 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 1073741824" returned: 0 in 0.892s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:07 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 Jul 09 03:26:07 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:08 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68" returned: 0 in 0.773s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:08 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8" returned: 0 in 0.672s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:08 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 Jul 09 03:26:08 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.292s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9143df-2d87-4f4f-93bc-f8588ce6940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1134e5e0-9d84-4584-a240-5efda47eb0c8', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461d53e1-5320-4d22-8668-8b2242f6735c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] Creating offline snapshot 6706df6a-2015-4a4e-bc20-3cc2cc918f22 of volume 11de47c0-32a5-4c6c-ac04-932cfb73348c {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:26:08 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Volume volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 (1134e5e0-9d84-4584-a240-5efda47eb0c8): created successfully Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461d53e1-5320-4d22-8668-8b2242f6735c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Flow 'volume_create_manager' (fd079182-3e42-4289-af39-a8f2c1eec506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b45399-60f2-42fd-a169-0bf50504ba5c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:08 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-48f6ee44-1caf-48f0-bb70-af457df721b3 tempest-SnapshotDependencyTests-1269696744 None] Created volume successfully. Jul 09 03:26:08 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c Jul 09 03:26:08 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:09 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68" returned: 1 in 0.793s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Downloaded image 1ec1ff40-aecb-43eb-ad70-8ea088c1a910 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'metadata': {}}])) to volume 836e0d74-1bfe-4768-ad66-828067059b68 successfully. {{(pid=87216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Temporary image 1ec1ff40-aecb-43eb-ad70-8ea088c1a910 for user 3a66a6ebaa3646f689eb5df833a44cc9 is deleted. {{(pid=87216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.volume.volume_utils [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Marking volume 836e0d74-1bfe-4768-ad66-828067059b68 as bootable. {{(pid=87216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Copying metadata from image 1ec1ff40-aecb-43eb-ad70-8ea088c1a910 to 836e0d74-1bfe-4768-ad66-828067059b68. {{(pid=87216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Creating volume glance metadata for volume 836e0d74-1bfe-4768-ad66-828067059b68 backed by image 1ec1ff40-aecb-43eb-ad70-8ea088c1a910 with: {'image_id': '1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7443b11437a668c2dfe2907fa8e601e5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4240ad02-0e33-4ee3-bd36-9dc40d17ce00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836e0d74-1bfe-4768-ad66-828067059b68', 'volume_size': 1, 'image_id': '1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7443b11437a668c2dfe2907fa8e601e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35abb971ff0b4cd590faf3d1da6b0105', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6943bc7651e242f377e44bdac0eb2cc3fb76d2f265c6926919f685bf702493c65808e9ab9daaa08aa18671f03371c1afeb8800f0802f40c9f0c8d195eab644b', 'id': '1ec1ff40-aecb-43eb-ad70-8ea088c1a910', 'created_at': datetime.datetime(2026, 7, 9, 1, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ec1ff40-aecb-43eb-ad70-8ea088c1a910/file', 'properties': {}}, 'image_service': }' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f700ea-a292-4421-82a2-ca6277cc8b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:09 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Volume volume-836e0d74-1bfe-4768-ad66-828067059b68 (836e0d74-1bfe-4768-ad66-828067059b68): created successfully Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f700ea-a292-4421-82a2-ca6277cc8b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Flow 'volume_create_manager' (0b55d812-a968-40b6-8bf6-7424c78cb742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:09 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-64b25543-f01b-4c36-ba85-14c98ede0abe tempest-VolumeImageDependencyTests-1594132102 None] Created volume successfully. Jul 09 03:26:09 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c" returned: 0 in 0.876s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:09 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 1G Jul 09 03:26:09 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Acquiring lock "cinder-836e0d74-1bfe-4768-ad66-828067059b68-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Lock "cinder-836e0d74-1bfe-4768-ad66-828067059b68-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Acquiring lock "cinder-quobyte-836e0d74-1bfe-4768-ad66-828067059b68" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Lock "cinder-quobyte-836e0d74-1bfe-4768-ad66-828067059b68" acquired by "delete_volume" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79e84a5-e43b-4e0a-9969-ca882e6edc41]: (4, 'raw') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:09 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 Jul 09 03:26:09 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:10 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 1G" returned: 0 in 0.853s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11de47c0-32a5-4c6c-ac04-932cfb73348c -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:10 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11de47c0-32a5-4c6c-ac04-932cfb73348c -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 Jul 09 03:26:10 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:10 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68" returned: 0 in 0.846s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:10 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 Jul 09 03:26:10 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:10 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11de47c0-32a5-4c6c-ac04-932cfb73348c -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22" returned: 0 in 0.696s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:10 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 is being set with open permissions: ugo+rw Jul 09 03:26:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:10 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 Jul 09 03:26:10 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:11 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68" returned: 1 in 0.793s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68' failed. Not Retrying. {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:26:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:11 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68 Jul 09 03:26:11 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:11 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22" returned: 0 in 0.660s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:11 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.info Jul 09 03:26:11 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:12 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-836e0d74-1bfe-4768-ad66-828067059b68" returned: 0 in 0.665s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Lock "cinder-quobyte-836e0d74-1bfe-4768-ad66-828067059b68" released by "delete_volume" :: held 2.376s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Created reservations ['f24768d1-3ac8-4255-b988-083291807ccd', 'bb9556b8-04b5-4744-870b-4d7ff2a38b89', '7129a875-c364-489b-8403-90b4207631d0', 'b24057fc-d846-479e-b8db-46936599b0f5'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:12 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:26:12 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:12 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.info" returned: 0 in 0.728s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:12 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.info is being set with open permissions: ugo+rw Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:12 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.info Jul 09 03:26:12 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:12 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.640s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:26:12 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Deleted volume successfully. Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d6d92991-19f3-40d7-9c0b-0d13f3bb67f1 tempest-VolumeImageDependencyTests-1594132102 None] Lock "cinder-836e0d74-1bfe-4768-ad66-828067059b68-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:12 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.info" returned: 0 in 0.642s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.563s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.953s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] Creating offline snapshot ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 of volume 1134e5e0-9d84-4584-a240-5efda47eb0c8 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:26:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-692f848b-eaea-4abd-a929-bde798d10d21 tempest-ProjectMemberTests-57018812 None] Create snapshot completed successfully Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4405bba8-7d3f-413e-95a1-5b782d48b1ad]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:13 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 Jul 09 03:26:13 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-6706df6a-2015-4a4e-bc20-3cc2cc918f22-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Lock "cinder-6706df6a-2015-4a4e-bc20-3cc2cc918f22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-11de47c0-32a5-4c6c-ac04-932cfb73348c" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-11de47c0-32a5-4c6c-ac04-932cfb73348c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-6706df6a-2015-4a4e-bc20-3cc2cc918f22" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-6706df6a-2015-4a4e-bc20-3cc2cc918f22" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Deleting offline snapshot 6706df6a-2015-4a4e-bc20-3cc2cc918f22 of volume 11de47c0-32a5-4c6c-ac04-932cfb73348c {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] snapshot_file for this snap is: volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1847c4fa-6229-4350-b098-89db647ca41d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:13 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 Jul 09 03:26:13 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:13 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:26:13 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:13 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8" returned: 0 in 0.884s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:14 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 1G Jul 09 03:26:14 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:14 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22" returned: 0 in 1.052s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:14 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11de47c0-32a5-4c6c-ac04-932cfb73348c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:26:14 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6057de-3ad7-4ae8-be2d-f6fca43912a1]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:14 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c Jul 09 03:26:14 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:14 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 1.026s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:26:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:26:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:26:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:26:15 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 1G" returned: 0 in 1.157s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:15 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 Jul 09 03:26:15 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:15 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c" returned: 0 in 0.946s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:15 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 Jul 09 03:26:15 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:15 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7" returned: 0 in 0.770s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:15 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 is being set with open permissions: ugo+rw Jul 09 03:26:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:15 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 Jul 09 03:26:15 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:16 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22" returned: 0 in 0.792s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:16 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22 Jul 09 03:26:16 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:16 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7" returned: 0 in 0.686s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:16 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.info Jul 09 03:26:16 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:17 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c.6706df6a-2015-4a4e-bc20-3cc2cc918f22" returned: 0 in 0.699s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-6706df6a-2015-4a4e-bc20-3cc2cc918f22" released by "_delete_snapshot" :: held 3.628s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-11de47c0-32a5-4c6c-ac04-932cfb73348c" released by "delete_snapshot" :: held 3.660s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Created reservations ['fcc9796f-778a-4bb2-ac5b-c9d4e57748c0', 'e713e6a6-2795-4696-9062-bc85bbf288d9', '045f778f-ca2e-49a5-b958-f9a386f0d948', '5f4a401f-9b85-45c0-9119-0852d7d5e2d8'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:17 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Delete snapshot completed successfully. Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d4fbceb0-b78d-4a2a-9571-3cc881d4b636 tempest-ProjectMemberTests-57018812 None] Lock "cinder-6706df6a-2015-4a4e-bc20-3cc2cc918f22-delete_snapshot" released by "delete_snapshot" :: held 3.830s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Flow 'volume_create_manager' (84af39bb-d2a7-4ec0-a423-c0bab336abcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26158dd1-bfdf-41fe-a518-ce8776ce56d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26158dd1-bfdf-41fe-a518-ce8776ce56d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1073223944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6e1abd-b1b8-40da-badb-3bea1538e259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4bbdabd4d444cb7b1f80239dd8aa661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:17Z,use_quota=True,user_id='c450ec0bc2c843e5b66af81c4dcad170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed8430d-d6cf-4c30-a966-827229b438d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed8430d-d6cf-4c30-a966-827229b438d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:17 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591691dd-a96c-4642-912f-867bf6a97187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591691dd-a96c-4642-912f-867bf6a97187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c6e1abd-b1b8-40da-badb-3bea1538e259', 'volume_name': 'volume-2c6e1abd-b1b8-40da-badb-3bea1538e259', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927076a2-e666-41a2-8fcb-185ba01befd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927076a2-e666-41a2-8fcb-185ba01befd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b16b121-5f1a-48ad-bcc3-8fe0ba242e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:17 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Volume 2c6e1abd-b1b8-40da-badb-3bea1538e259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c6e1abd-b1b8-40da-badb-3bea1538e259', 'volume_size': 1} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.info" returned: 0 in 0.791s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:17 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.info is being set with open permissions: ugo+rw Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:17 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.info Jul 09 03:26:17 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-11de47c0-32a5-4c6c-ac04-932cfb73348c-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Lock "cinder-11de47c0-32a5-4c6c-ac04-932cfb73348c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-11de47c0-32a5-4c6c-ac04-932cfb73348c" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-11de47c0-32a5-4c6c-ac04-932cfb73348c" acquired by "delete_volume" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[75483ef6-a029-40b7-b6bb-a125c99e78a5]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:17 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c Jul 09 03:26:17 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:18 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.info" returned: 0 in 0.679s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.096s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1073223944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6e1abd-b1b8-40da-badb-3bea1538e259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4bbdabd4d444cb7b1f80239dd8aa661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:17Z,use_quota=True,user_id='c450ec0bc2c843e5b66af81c4dcad170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Creating volume 2c6e1abd-b1b8-40da-badb-3bea1538e259 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:26:18 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:18 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 1073741824 Jul 09 03:26:18 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:18 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-b50c2b17-e6f9-4155-b7e3-5bb6070f08aa tempest-SnapshotDependencyTests-1269696744 None] Create snapshot completed successfully Jul 09 03:26:18 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c" returned: 0 in 0.788s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:18 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c Jul 09 03:26:18 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:19 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 1073741824" returned: 0 in 0.907s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=138,cinder:INSERT=41,cinder:UPDATE=184,cinder:DELETE=14 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=157,cinder:SELECT=105,cinder:DELETE=15,cinder:INSERT=48 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:26:19 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 Jul 09 03:26:19 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Flow 'volume_create_manager' (7f216934-b893-4942-8c4e-1a36f68ea317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a599ede9-e3c9-4323-b752-1671f7a99549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a599ede9-e3c9-4323-b752-1671f7a99549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8045ebba-5e52-407d-bd34-5523f39ccdf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ba014154504a80893095c333470d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:19Z,use_quota=True,user_id='655ae464f57e454892d9239b1601d5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e9f919-f59e-430b-8539-efec8a85e693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e9f919-f59e-430b-8539-efec8a85e693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5257e206-06f2-4d5c-9fff-541c26858385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5257e206-06f2-4d5c-9fff-541c26858385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8045ebba-5e52-407d-bd34-5523f39ccdf6', 'volume_name': 'volume-8045ebba-5e52-407d-bd34-5523f39ccdf6', 'volume_size': 1, 'snapshot_id': 'ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d498bf8d-489e-4b06-98c1-fc0efe960716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d498bf8d-489e-4b06-98c1-fc0efe960716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f205381-0926-4b24-95da-f1d2ab8e34c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:19 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Volume 8045ebba-5e52-407d-bd34-5523f39ccdf6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8045ebba-5e52-407d-bd34-5523f39ccdf6', 'volume_size': 1, 'snapshot_id': 'ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7'} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:19 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-11de47c0-32a5-4c6c-ac04-932cfb73348c" returned: 0 in 0.695s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-11de47c0-32a5-4c6c-ac04-932cfb73348c" released by "delete_volume" :: held 1.533s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Created reservations ['41254242-ca14-4808-8f44-f5c7c74a05ef', '0df3b112-d5a6-42cd-8333-4477276367ad', '448ded44-5e79-4313-86e7-690d94036aea', '49bfb77f-2c0a-458c-ac47-2df95b867826'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:19 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:26:19 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:19 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259" returned: 0 in 0.734s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.602s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "cinder-quobyte-ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7-8045ebba-5e52-407d-bd34-5523f39ccdf6" by "_create_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b16b121-5f1a-48ad-bcc3-8fe0ba242e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6e1abd-b1b8-40da-badb-3bea1538e259', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bf115e-5826-4fc1-867a-bff5dbf9a53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7-8045ebba-5e52-407d-bd34-5523f39ccdf6" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Creating volume 8045ebba-5e52-407d-bd34-5523f39ccdf6 from snapshot ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 {{(pid=87216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "cinder-quobyte-8045ebba-5e52-407d-bd34-5523f39ccdf6" by "_copy_volume_from_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:19 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Volume volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 (2c6e1abd-b1b8-40da-badb-3bea1538e259): created successfully Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bf115e-5826-4fc1-867a-bff5dbf9a53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Flow 'volume_create_manager' (84af39bb-d2a7-4ec0-a423-c0bab336abcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-8045ebba-5e52-407d-bd34-5523f39ccdf6" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] snapshot: ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7, volume: 8045ebba-5e52-407d-bd34-5523f39ccdf6, {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:26:19 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-99522f5b-8b29-4bf8-aefe-06883a24533f tempest-ProjectReaderTests-746529896 None] Created volume successfully. Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07371011-8c91-49e1-adb9-1ea7830b7a93]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:20 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.702s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:26:20 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Deleted volume successfully. Jul 09 03:26:20 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 Jul 09 03:26:20 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-8cceef40-c170-48cc-ae27-ecdf1a7c884f tempest-ProjectMemberTests-57018812 None] Lock "cinder-11de47c0-32a5-4c6c-ac04-932cfb73348c-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (18174d46-a554-4167-8648-197f3166c25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335f023c-5ec8-4ad2-93d6-f46cf2a93c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335f023c-5ec8-4ad2-93d6-f46cf2a93c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1016214123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca2d2fc-00b8-4d74-9086-eefe510d1f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:20Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115fe08d-7522-4039-84cd-bdf8685aa0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115fe08d-7522-4039-84cd-bdf8685aa0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93fcefc-8aad-4168-a5f7-cc2a6a276c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93fcefc-8aad-4168-a5f7-cc2a6a276c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca2d2fc-00b8-4d74-9086-eefe510d1f08', 'volume_name': 'volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310cc619-4b5e-4766-911f-e25189b6555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310cc619-4b5e-4766-911f-e25189b6555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d51ebb-ef21-4f29-ba18-f98e82bdd661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:20 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Volume 2ca2d2fc-00b8-4d74-9086-eefe510d1f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08', 'volume_size': 1} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:20 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7" returned: 0 in 0.789s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1134e5e0-9d84-4584-a240-5efda47eb0c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Creating direct copy from snapshot {{(pid=87216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9e8e38-8227-4b7d-8ad0-d0d6b35476aa]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:20 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 Jul 09 03:26:20 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:21 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8" returned: 0 in 0.767s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:21 devstack cinder-volume[87216]: DEBUG cinder.utils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Path /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 not found in is_blk_device check {{(pid=87216) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:26:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:21 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 Jul 09 03:26:21 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:26 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6" returned: 0 in 4.548s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:26 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b578e6-9a50-40a3-b64c-d1776a31e64e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:26 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 Jul 09 03:26:26 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:27 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8" returned: 0 in 0.921s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.image.image_utils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Image conversion details: src /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 {{(pid=87216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:26:27 devstack cinder-volume[87216]: INFO cinder.image.image_utils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Converted 1024.00 MB image at 225.10 MB/s Jul 09 03:26:27 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 is being set with open permissions: ugo+rw Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:27 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 Jul 09 03:26:27 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:27 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6" returned: 0 in 0.619s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-8045ebba-5e52-407d-bd34-5523f39ccdf6" released by "_copy_volume_from_snapshot" :: held 7.790s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7-8045ebba-5e52-407d-bd34-5523f39ccdf6" released by "_create_volume_from_snapshot" :: held 7.847s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.891s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.096s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1016214123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca2d2fc-00b8-4d74-9086-eefe510d1f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:20Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Creating volume 2ca2d2fc-00b8-4d74-9086-eefe510d1f08 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:26:27 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:27 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 1073741824 Jul 09 03:26:27 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f205381-0926-4b24-95da-f1d2ab8e34c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8045ebba-5e52-407d-bd34-5523f39ccdf6', 'volume_size': 1, 'snapshot_id': 'ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7'}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee8b930-b162-4502-beee-f2594ed27488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:27 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Volume volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 (8045ebba-5e52-407d-bd34-5523f39ccdf6): created successfully Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee8b930-b162-4502-beee-f2594ed27488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:27 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Flow 'volume_create_manager' (7f216934-b893-4942-8c4e-1a36f68ea317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:27 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-10c1d206-785d-4e2e-9877-a2fbc937785f tempest-SnapshotDependencyTests-1269696744 None] Created volume successfully. Jul 09 03:26:28 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 1073741824" returned: 0 in 0.794s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:28 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 Jul 09 03:26:28 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "cinder-ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "cinder-quobyte-1134e5e0-9d84-4584-a240-5efda47eb0c8" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-1134e5e0-9d84-4584-a240-5efda47eb0c8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "cinder-quobyte-ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Deleting offline snapshot ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 of volume 1134e5e0-9d84-4584-a240-5efda47eb0c8 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] snapshot_file for this snap is: volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b87e86-26d0-4782-83af-0ef983e3d916]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:29 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 Jul 09 03:26:29 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:29 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08" returned: 0 in 0.646s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.555s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] Creating offline snapshot e859ecf3-7317-4a30-ad96-8660adffc296 of volume 2c6e1abd-b1b8-40da-badb-3bea1538e259 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d51ebb-ef21-4f29-ba18-f98e82bdd661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaeeda0-c674-4d74-a419-c21eeb5c9604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb99055-a600-4cc2-9e0f-1cf0877d9f86]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:29 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Volume volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 (2ca2d2fc-00b8-4d74-9086-eefe510d1f08): created successfully Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaeeda0-c674-4d74-a419-c21eeb5c9604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (18174d46-a554-4167-8648-197f3166c25e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:29 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-84d95d0f-1c4c-4678-8a48-9efbb1986094 tempest-ProjectMemberTests-57018812 None] Created volume successfully. Jul 09 03:26:29 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 Jul 09 03:26:29 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:29 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7" returned: 0 in 0.771s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1134e5e0-9d84-4584-a240-5efda47eb0c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6ace34-024b-429d-8b91-fcf84f55df8b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:29 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 Jul 09 03:26:29 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:30 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259" returned: 0 in 0.744s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:30 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 1G Jul 09 03:26:30 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:30 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8" returned: 0 in 0.779s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:30 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 Jul 09 03:26:30 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:30 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 1G" returned: 0 in 0.820s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:30 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 Jul 09 03:26:30 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:31 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7" returned: 0 in 0.774s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:31 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7 Jul 09 03:26:31 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:31 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296" returned: 0 in 0.663s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:31 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 is being set with open permissions: ugo+rw Jul 09 03:26:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:31 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 Jul 09 03:26:31 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:31 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8.ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7" returned: 0 in 0.668s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7" released by "_delete_snapshot" :: held 3.101s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-1134e5e0-9d84-4584-a240-5efda47eb0c8" released by "delete_snapshot" :: held 3.127s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:32 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Created reservations ['1519713a-9ec2-4d5b-b521-4e2712313ec5', '781cc2be-9e6c-490f-8b51-4dafb4bdfea0', 'fd211e2c-6929-400a-9732-4f87d8c0f425', 'e4a4ed3a-7fdf-42d6-a23a-1c0ee26bbde9'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:32 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296" returned: 0 in 0.660s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Delete snapshot completed successfully. Jul 09 03:26:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2ea2e82f-f428-4564-bab8-457c36e2a8a6 tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-ccbe9997-5f66-4c2b-99e0-fc2f7cb253b7-delete_snapshot" released by "delete_snapshot" :: held 3.264s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:32 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.info Jul 09 03:26:32 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:32 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.info" returned: 0 in 0.628s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:32 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.info is being set with open permissions: ugo+rw Jul 09 03:26:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:32 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.info Jul 09 03:26:32 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "cinder-1134e5e0-9d84-4584-a240-5efda47eb0c8-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-1134e5e0-9d84-4584-a240-5efda47eb0c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "cinder-quobyte-1134e5e0-9d84-4584-a240-5efda47eb0c8" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-1134e5e0-9d84-4584-a240-5efda47eb0c8" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2190283-e8fc-4f80-bed7-bc96a88efc56]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:33 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 Jul 09 03:26:33 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:33 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.info" returned: 0 in 0.648s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.267s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.023s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] Creating offline snapshot cb11f21a-b494-401a-9bcf-f7db388c5c5f of volume 2ca2d2fc-00b8-4d74-9086-eefe510d1f08 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:26:33 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2d62ca92-f501-475e-917c-cdb6f06c0b7c tempest-ProjectReaderTests-746529896 None] Create snapshot completed successfully Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7e5f16-57ba-4ca3-b81b-cb7fe1cbabcf]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:33 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 Jul 09 03:26:33 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:34 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8" returned: 0 in 0.781s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:34 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8 Jul 09 03:26:34 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:34 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08" returned: 0 in 0.808s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:34 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f 1G Jul 09 03:26:34 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-e859ecf3-7317-4a30-ad96-8660adffc296-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Lock "cinder-e859ecf3-7317-4a30-ad96-8660adffc296-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-2c6e1abd-b1b8-40da-badb-3bea1538e259" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-2c6e1abd-b1b8-40da-badb-3bea1538e259" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-e859ecf3-7317-4a30-ad96-8660adffc296" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-e859ecf3-7317-4a30-ad96-8660adffc296" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Deleting offline snapshot e859ecf3-7317-4a30-ad96-8660adffc296 of volume 2c6e1abd-b1b8-40da-badb-3bea1538e259 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] snapshot_file for this snap is: volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9765b8-5bc8-4ccb-bb16-8870e601dba4]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:34 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 Jul 09 03:26:34 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:34 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-1134e5e0-9d84-4584-a240-5efda47eb0c8" returned: 0 in 0.696s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-1134e5e0-9d84-4584-a240-5efda47eb0c8" released by "delete_volume" :: held 1.537s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Created reservations ['eb2b649c-916a-40e0-9bba-999270c08e2c', '65762a64-377a-45bf-8313-0193ea581a91', 'a7e4e63d-d64a-4596-a1a2-f292678c546a', '6c712f05-db5d-42af-8e11-30a938596112'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:34 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:26:34 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:35 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f 1G" returned: 0 in 0.861s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:35 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f Jul 09 03:26:35 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "cinder-8045ebba-5e52-407d-bd34-5523f39ccdf6-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-8045ebba-5e52-407d-bd34-5523f39ccdf6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:35 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296" returned: 0 in 0.869s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c6e1abd-b1b8-40da-badb-3bea1538e259(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9672380b-908f-4225-97b1-42a888f7e5af]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "cinder-quobyte-8045ebba-5e52-407d-bd34-5523f39ccdf6" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-8045ebba-5e52-407d-bd34-5523f39ccdf6" acquired by "delete_volume" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede47a08-9d16-4362-ad8d-94df5871c70f]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:35 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.747s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:26:35 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Deleted volume successfully. Jul 09 03:26:35 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 Jul 09 03:26:35 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4a7d7ccc-95bf-4f7e-9a58-ccf5d485c5af tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-1134e5e0-9d84-4584-a240-5efda47eb0c8-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:35 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 Jul 09 03:26:35 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:36 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f" returned: 0 in 0.789s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:36 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f is being set with open permissions: ugo+rw Jul 09 03:26:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:36 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f Jul 09 03:26:36 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:36 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259" returned: 0 in 0.810s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:36 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 Jul 09 03:26:36 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:36 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6" returned: 0 in 0.834s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:36 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6 Jul 09 03:26:36 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:36 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f" returned: 0 in 0.676s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:36 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.info Jul 09 03:26:36 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:37 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8045ebba-5e52-407d-bd34-5523f39ccdf6" returned: 0 in 0.675s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-quobyte-8045ebba-5e52-407d-bd34-5523f39ccdf6" released by "delete_volume" :: held 1.564s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:37 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296" returned: 0 in 0.828s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:37 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296 Jul 09 03:26:37 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Created reservations ['a0ac3f0a-1cd2-4af8-b6f8-3200f375a6a9', '5dcea094-577e-44ab-98a5-ebf90552a1b1', '42ef57d8-7150-46ce-8bae-f1fc57a5338e', '91be0d38-d98c-4972-9a3b-7f1909ee7262'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:37 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:26:37 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:37 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.info" returned: 0 in 0.677s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:37 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.info is being set with open permissions: ugo+rw Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:37 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.info Jul 09 03:26:37 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:37 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259.e859ecf3-7317-4a30-ad96-8660adffc296" returned: 0 in 0.736s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-e859ecf3-7317-4a30-ad96-8660adffc296" released by "_delete_snapshot" :: held 3.374s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:37 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.673s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-2c6e1abd-b1b8-40da-badb-3bea1538e259" released by "delete_snapshot" :: held 3.400s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:37 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Deleted volume successfully. Jul 09 03:26:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d24758f2-8018-4e53-bec1-cb39a17ea77e tempest-SnapshotDependencyTests-1269696744 None] Lock "cinder-8045ebba-5e52-407d-bd34-5523f39ccdf6-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Created reservations ['a86035bb-ec91-4348-ab55-84ab843a99d9', '21dcda2c-c273-41c9-ade9-bb9145cfa786', 'a9241d06-54f7-496d-aeaa-5666915209da', '32a52e39-2516-4734-add3-911a9eefa5e1'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:38 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.info" returned: 0 in 0.665s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.596s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-254032f7-cd2d-49a1-bf5e-f08ad7c99cb0 tempest-ProjectMemberTests-57018812 None] Create snapshot completed successfully Jul 09 03:26:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Delete snapshot completed successfully. Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-7f69f430-9931-4cb4-a556-ba6baf070e2b tempest-ProjectReaderTests-746529896 None] Lock "cinder-e859ecf3-7317-4a30-ad96-8660adffc296-delete_snapshot" released by "delete_snapshot" :: held 3.627s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-2c6e1abd-b1b8-40da-badb-3bea1538e259-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Lock "cinder-2c6e1abd-b1b8-40da-badb-3bea1538e259-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-2c6e1abd-b1b8-40da-badb-3bea1538e259" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-2c6e1abd-b1b8-40da-badb-3bea1538e259" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-cb11f21a-b494-401a-9bcf-f7db388c5c5f-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8370b0-9ff4-4c05-999f-f304b7779b84]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Lock "cinder-cb11f21a-b494-401a-9bcf-f7db388c5c5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-2ca2d2fc-00b8-4d74-9086-eefe510d1f08" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-2ca2d2fc-00b8-4d74-9086-eefe510d1f08" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-cb11f21a-b494-401a-9bcf-f7db388c5c5f" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-cb11f21a-b494-401a-9bcf-f7db388c5c5f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Deleting offline snapshot cb11f21a-b494-401a-9bcf-f7db388c5c5f of volume 2ca2d2fc-00b8-4d74-9086-eefe510d1f08 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:26:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] snapshot_file for this snap is: volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:26:39 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdda62e-02ab-43b4-80cb-3db705155fdb]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:39 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 Jul 09 03:26:39 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:39 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f Jul 09 03:26:39 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:39 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259" returned: 0 in 0.838s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:39 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259 Jul 09 03:26:39 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:39 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f" returned: 0 in 0.862s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:26:39 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d17d136-1918-49c0-9424-acfa5abe114d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:40 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 Jul 09 03:26:40 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:40 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2c6e1abd-b1b8-40da-badb-3bea1538e259" returned: 0 in 0.724s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-2c6e1abd-b1b8-40da-badb-3bea1538e259" released by "delete_volume" :: held 1.666s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:40 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Created reservations ['ff074f87-d652-42f5-9726-255c79c09ce2', '5a67c6fe-efc7-4b73-9080-681ed4d99348', '1956f2a8-257e-4b4b-a686-b3ca003e4e18', '2c3c8bb6-9bf2-4ad2-9fe9-4d812015836d'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:40 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:26:40 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:40 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08" returned: 0 in 0.915s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:40 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f Jul 09 03:26:40 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:41 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.842s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:26:41 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Deleted volume successfully. Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-379cecab-1aa6-43c3-b2c5-351476b5c30b tempest-ProjectReaderTests-746529896 None] Lock "cinder-2c6e1abd-b1b8-40da-badb-3bea1538e259-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Flow 'volume_create_manager' (5168434f-ea30-44c5-90dd-c3f1933881bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fa435d-2af2-457b-80c3-10e4274c3ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fa435d-2af2-457b-80c3-10e4274c3ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847236123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9247c6-cf07-412e-9049-5aaa43d4358c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4bbdabd4d444cb7b1f80239dd8aa661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:42Z,use_quota=True,user_id='c450ec0bc2c843e5b66af81c4dcad170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793730cd-6c9f-496c-99e8-7bfe45491305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793730cd-6c9f-496c-99e8-7bfe45491305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b873de-7f4e-4fd5-b5f4-3dfc9a3eb13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b873de-7f4e-4fd5-b5f4-3dfc9a3eb13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c9247c6-cf07-412e-9049-5aaa43d4358c', 'volume_name': 'volume-7c9247c6-cf07-412e-9049-5aaa43d4358c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74195fcb-05eb-4730-beff-94ca15db47b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74195fcb-05eb-4730-beff-94ca15db47b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c320dbd8-5060-4769-8686-2d9779f25fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:41 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Volume 7c9247c6-cf07-412e-9049-5aaa43d4358c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c9247c6-cf07-412e-9049-5aaa43d4358c', 'volume_size': 1} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847236123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9247c6-cf07-412e-9049-5aaa43d4358c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4bbdabd4d444cb7b1f80239dd8aa661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:42Z,use_quota=True,user_id='c450ec0bc2c843e5b66af81c4dcad170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Creating volume 7c9247c6-cf07-412e-9049-5aaa43d4358c {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:26:41 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:41 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c 1073741824 Jul 09 03:26:41 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:41 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f" returned: 0 in 1.020s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:41 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f Jul 09 03:26:41 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:42 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08.cb11f21a-b494-401a-9bcf-f7db388c5c5f" returned: 0 in 0.700s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-cb11f21a-b494-401a-9bcf-f7db388c5c5f" released by "_delete_snapshot" :: held 3.610s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-2ca2d2fc-00b8-4d74-9086-eefe510d1f08" released by "delete_snapshot" :: held 3.633s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:42 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c 1073741824" returned: 0 in 0.921s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:42 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Created reservations ['673e514c-4af7-439b-ade3-c02bcf88b118', '290cfdea-123c-4482-8344-8383e26e6528', 'afad9935-acf1-4d2a-9e4b-dae0bab802ff', 'edd8f921-dac2-42e9-bd49-52fbb6f93a4a'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:42 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c Jul 09 03:26:42 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:42 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Delete snapshot completed successfully. Jul 09 03:26:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-ee500402-abc3-4ec4-b306-e19079b2cafd tempest-ProjectMemberTests-57018812 None] Lock "cinder-cb11f21a-b494-401a-9bcf-f7db388c5c5f-delete_snapshot" released by "delete_snapshot" :: held 3.803s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-2ca2d2fc-00b8-4d74-9086-eefe510d1f08-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Lock "cinder-2ca2d2fc-00b8-4d74-9086-eefe510d1f08-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-2ca2d2fc-00b8-4d74-9086-eefe510d1f08" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-2ca2d2fc-00b8-4d74-9086-eefe510d1f08" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74af050-897c-4eab-9a2b-80732556db5a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:43 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 Jul 09 03:26:43 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:43 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c" returned: 0 in 0.752s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c320dbd8-5060-4769-8686-2d9779f25fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9247c6-cf07-412e-9049-5aaa43d4358c', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcd4d61-f1ae-4af7-8fe8-47087fa3115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:43 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Volume volume-7c9247c6-cf07-412e-9049-5aaa43d4358c (7c9247c6-cf07-412e-9049-5aaa43d4358c): created successfully Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcd4d61-f1ae-4af7-8fe8-47087fa3115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Flow 'volume_create_manager' (5168434f-ea30-44c5-90dd-c3f1933881bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f6b7fa84-4cb5-4b27-9ca4-54ffca7def11 tempest-ProjectReaderTests-746529896 None] Created volume successfully. Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] Creating offline snapshot 6f4e1bee-a376-450b-860e-ff29790ad40e of volume 7c9247c6-cf07-412e-9049-5aaa43d4358c {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d1298e-4721-4c4b-81c0-084e686041eb]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:44 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c Jul 09 03:26:44 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:44 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08" returned: 0 in 0.872s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:44 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08 Jul 09 03:26:44 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:44 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c" returned: 0 in 0.917s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:44 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e 1G Jul 09 03:26:44 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:44 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-2ca2d2fc-00b8-4d74-9086-eefe510d1f08" returned: 0 in 0.780s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-2ca2d2fc-00b8-4d74-9086-eefe510d1f08" released by "delete_volume" :: held 1.736s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:45 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Created reservations ['5643043e-19c9-4581-91ff-f54a3ee9a619', '79143701-78f8-40dd-8267-423cf995c9df', 'c8d34639-01e8-438f-ab74-468578341fe1', '72f4cefb-ba7d-4213-8481-c01f603bd11f'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:45 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:26:45 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:45 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e 1G" returned: 0 in 1.005s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9247c6-cf07-412e-9049-5aaa43d4358c -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:45 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9247c6-cf07-412e-9049-5aaa43d4358c -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e Jul 09 03:26:45 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:46 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.792s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:26:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Deleted volume successfully. Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-0b7d0371-7104-40a5-bae6-8f0c703acb98 tempest-ProjectMemberTests-57018812 None] Lock "cinder-2ca2d2fc-00b8-4d74-9086-eefe510d1f08-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (236bc87d-5c83-4b79-894e-530777681d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc9648e-8853-4481-9e6f-4ef75085017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc9648e-8853-4481-9e6f-4ef75085017d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-817566336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5342899-a8d5-4d0d-acb3-12295dd39888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:46Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af491183-5b3e-4e85-9d89-dcd86b2d27e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af491183-5b3e-4e85-9d89-dcd86b2d27e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b83c21-573e-4657-908f-0050d8bd1b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b83c21-573e-4657-908f-0050d8bd1b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5342899-a8d5-4d0d-acb3-12295dd39888', 'volume_name': 'volume-b5342899-a8d5-4d0d-acb3-12295dd39888', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb523e8c-1ad1-4fab-a038-8be2045d578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb523e8c-1ad1-4fab-a038-8be2045d578b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738c58d7-56ca-4c3d-9a73-3dd72e16b574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:46 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Volume b5342899-a8d5-4d0d-acb3-12295dd39888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5342899-a8d5-4d0d-acb3-12295dd39888', 'volume_size': 1} Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:46 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9247c6-cf07-412e-9049-5aaa43d4358c -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e" returned: 0 in 0.806s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:46 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e is being set with open permissions: ugo+rw Jul 09 03:26:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:46 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e Jul 09 03:26:46 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:47 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e" returned: 0 in 0.671s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:47 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.info Jul 09 03:26:47 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:47 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.info" returned: 0 in 0.660s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:47 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.info is being set with open permissions: ugo+rw Jul 09 03:26:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:48 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.info Jul 09 03:26:48 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:48 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.info" returned: 0 in 0.644s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.786s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.453s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-817566336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5342899-a8d5-4d0d-acb3-12295dd39888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:46Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Creating volume b5342899-a8d5-4d0d-acb3-12295dd39888 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:26:48 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:26:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:48 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 1073741824 Jul 09 03:26:48 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-65154385-4c79-4035-a682-96cff3f4e8ca tempest-ProjectReaderTests-746529896 None] Create snapshot completed successfully Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-6f4e1bee-a376-450b-860e-ff29790ad40e-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Lock "cinder-6f4e1bee-a376-450b-860e-ff29790ad40e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-7c9247c6-cf07-412e-9049-5aaa43d4358c" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-7c9247c6-cf07-412e-9049-5aaa43d4358c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-6f4e1bee-a376-450b-860e-ff29790ad40e" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-6f4e1bee-a376-450b-860e-ff29790ad40e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Deleting offline snapshot 6f4e1bee-a376-450b-860e-ff29790ad40e of volume 7c9247c6-cf07-412e-9049-5aaa43d4358c {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] snapshot_file for this snap is: volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[826c1d4b-c36f-46f5-86cc-1ce073244dfa]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:49 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e Jul 09 03:26:49 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:49 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 1073741824" returned: 0 in 0.817s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:49 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 Jul 09 03:26:49 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:50 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e" returned: 0 in 0.758s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c9247c6-cf07-412e-9049-5aaa43d4358c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[65870ce4-0663-48ff-a639-f8d2748a0254]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:50 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c Jul 09 03:26:50 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:50 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888" returned: 0 in 0.637s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738c58d7-56ca-4c3d-9a73-3dd72e16b574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5342899-a8d5-4d0d-acb3-12295dd39888', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb5a114-fa4d-4910-91db-c787071a59f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:50 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Volume volume-b5342899-a8d5-4d0d-acb3-12295dd39888 (b5342899-a8d5-4d0d-acb3-12295dd39888): created successfully Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb5a114-fa4d-4910-91db-c787071a59f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (236bc87d-5c83-4b79-894e-530777681d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:50 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c26e533d-b06e-41fe-9ff9-6c391446e1f6 tempest-ProjectMemberTests-57018812 None] Created volume successfully. Jul 09 03:26:50 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c" returned: 0 in 0.773s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:50 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e Jul 09 03:26:50 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:51 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] Creating offline snapshot b292dddd-5315-48a4-bd51-ff384120a62e of volume b5342899-a8d5-4d0d-acb3-12295dd39888 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:26:51 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b020f4e6-13e1-4d94-be45-e1974dd205f1]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:51 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e" returned: 0 in 0.765s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:51 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 Jul 09 03:26:51 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:51 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e Jul 09 03:26:51 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:52 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c.6f4e1bee-a376-450b-860e-ff29790ad40e" returned: 0 in 0.636s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-6f4e1bee-a376-450b-860e-ff29790ad40e" released by "_delete_snapshot" :: held 3.037s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:52 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888" returned: 0 in 0.775s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-7c9247c6-cf07-412e-9049-5aaa43d4358c" released by "delete_snapshot" :: held 3.073s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:52 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e 1G Jul 09 03:26:52 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:52 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Created reservations ['c7811c0a-f704-423e-8f90-3b140730c081', 'ff49061a-6f1c-47dd-a278-5ba0faffd302', '8434a597-0970-4d58-882b-dc65f280416f', '5ad245b6-18aa-4864-9446-037490b96c39'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:52 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Delete snapshot completed successfully. Jul 09 03:26:52 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4ed72c65-8b5f-4af1-b80d-a4071a399812 tempest-ProjectReaderTests-746529896 None] Lock "cinder-6f4e1bee-a376-450b-860e-ff29790ad40e-delete_snapshot" released by "delete_snapshot" :: held 3.221s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:53 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e 1G" returned: 0 in 0.779s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5342899-a8d5-4d0d-acb3-12295dd39888 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:53 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5342899-a8d5-4d0d-acb3-12295dd39888 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e Jul 09 03:26:53 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-7c9247c6-cf07-412e-9049-5aaa43d4358c-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Lock "cinder-7c9247c6-cf07-412e-9049-5aaa43d4358c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-7c9247c6-cf07-412e-9049-5aaa43d4358c" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:53 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-7c9247c6-cf07-412e-9049-5aaa43d4358c" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:53 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6eb385-750d-4a1e-a6e2-82b367f09065]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:53 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c Jul 09 03:26:53 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:53 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5342899-a8d5-4d0d-acb3-12295dd39888 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e" returned: 0 in 0.685s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:53 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e is being set with open permissions: ugo+rw Jul 09 03:26:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:53 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e Jul 09 03:26:53 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:54 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c" returned: 0 in 0.754s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:54 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c Jul 09 03:26:54 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:54 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e" returned: 0 in 0.664s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:54 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.info Jul 09 03:26:54 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:54 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7c9247c6-cf07-412e-9049-5aaa43d4358c" returned: 0 in 0.650s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-7c9247c6-cf07-412e-9049-5aaa43d4358c" released by "delete_volume" :: held 1.472s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:54 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Created reservations ['0594174f-ed08-465f-a030-6a9209cfd0f8', '61e57a9c-28c8-4818-bc62-c888719804f4', 'd23cac16-cfc7-48e9-86c3-2058cb4ef173', 'ea8a98fc-a554-441e-90ad-1516b191853c'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:26:55 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.info" returned: 0 in 0.652s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:55 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.info is being set with open permissions: ugo+rw Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:55 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:26:55 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:55 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.info Jul 09 03:26:55 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:55 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:55 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.646s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.info" returned: 0 in 0.638s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.278s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Deleted volume successfully. Jul 09 03:26:55 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1b9eed67-d50b-403c-8fa2-dad112f1d03c tempest-ProjectMemberTests-57018812 None] Create snapshot completed successfully Jul 09 03:26:55 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-552c75f4-311d-4aa4-b6a2-6c2375351f6f tempest-ProjectReaderTests-746529896 None] Lock "cinder-7c9247c6-cf07-412e-9049-5aaa43d4358c-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Flow 'volume_create_manager' (424b1ece-62ef-48b5-9983-539b34d81b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421b7194-604b-4284-8685-aace7a981136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421b7194-604b-4284-8685-aace7a981136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1202954816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc666b8-2180-41b7-b85a-75644372bb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4bbdabd4d444cb7b1f80239dd8aa661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:56Z,use_quota=True,user_id='c450ec0bc2c843e5b66af81c4dcad170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0677c63-23af-469c-8a02-9703707df1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0677c63-23af-469c-8a02-9703707df1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9584216-94a0-445c-b0bc-4d9ef847338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9584216-94a0-445c-b0bc-4d9ef847338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc666b8-2180-41b7-b85a-75644372bb90', 'volume_name': 'volume-8bc666b8-2180-41b7-b85a-75644372bb90', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ad4816-fbc0-4e45-83b5-e042a1866b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ad4816-fbc0-4e45-83b5-e042a1866b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d34fdd-f696-4970-adff-489421d182b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:56 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Volume 8bc666b8-2180-41b7-b85a-75644372bb90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc666b8-2180-41b7-b85a-75644372bb90', 'volume_size': 1} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1202954816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc666b8-2180-41b7-b85a-75644372bb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4bbdabd4d444cb7b1f80239dd8aa661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:26:56Z,use_quota=True,user_id='c450ec0bc2c843e5b66af81c4dcad170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Creating volume 8bc666b8-2180-41b7-b85a-75644372bb90 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:26:56 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:56 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 1073741824 Jul 09 03:26:56 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-b292dddd-5315-48a4-bd51-ff384120a62e-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Lock "cinder-b292dddd-5315-48a4-bd51-ff384120a62e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-b5342899-a8d5-4d0d-acb3-12295dd39888" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-b5342899-a8d5-4d0d-acb3-12295dd39888" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-b292dddd-5315-48a4-bd51-ff384120a62e" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-b292dddd-5315-48a4-bd51-ff384120a62e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Deleting offline snapshot b292dddd-5315-48a4-bd51-ff384120a62e of volume b5342899-a8d5-4d0d-acb3-12295dd39888 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] snapshot_file for this snap is: volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdf6d7b-7bc7-497f-a175-560c8993aaea]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:56 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e Jul 09 03:26:56 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:56 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 1073741824" returned: 0 in 0.819s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:57 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 Jul 09 03:26:57 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:57 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e" returned: 0 in 0.779s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5342899-a8d5-4d0d-acb3-12295dd39888(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a29d728-b94d-4e9f-9e13-485bd10dadc2]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:57 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90" returned: 0 in 0.643s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d34fdd-f696-4970-adff-489421d182b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc666b8-2180-41b7-b85a-75644372bb90', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb34e96-7efd-4950-8b2a-969821ffa1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:26:57 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Volume volume-8bc666b8-2180-41b7-b85a-75644372bb90 (8bc666b8-2180-41b7-b85a-75644372bb90): created successfully Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb34e96-7efd-4950-8b2a-969821ffa1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:26:57 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 Jul 09 03:26:57 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:57 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Flow 'volume_create_manager' (424b1ece-62ef-48b5-9983-539b34d81b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:26:57 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a6f43ca9-c0f1-4d58-8838-eced270c0914 tempest-ProjectReaderTests-746529896 None] Created volume successfully. Jul 09 03:26:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:26:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:26:58 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] Creating offline snapshot d4cdb18b-74e7-466f-83af-47394eeeb672 of volume 8bc666b8-2180-41b7-b85a-75644372bb90 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:26:58 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e843ba72-8e5f-49c0-89b2-888a6259774e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:26:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:58 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888" returned: 0 in 0.801s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:58 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 Jul 09 03:26:58 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:58 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e Jul 09 03:26:58 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:59 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90" returned: 0 in 0.779s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:59 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 1G Jul 09 03:26:59 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:59 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e" returned: 0 in 0.756s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:59 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e Jul 09 03:26:59 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:59 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888.b292dddd-5315-48a4-bd51-ff384120a62e" returned: 0 in 0.646s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-b292dddd-5315-48a4-bd51-ff384120a62e" released by "_delete_snapshot" :: held 3.079s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-b5342899-a8d5-4d0d-acb3-12295dd39888" released by "delete_snapshot" :: held 3.105s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:26:59 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 09 03:26:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 1G" returned: 0 in 0.794s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:26:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bc666b8-2180-41b7-b85a-75644372bb90 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:26:59 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bc666b8-2180-41b7-b85a-75644372bb90 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 Jul 09 03:26:59 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:26:59 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Created reservations ['6bf3f917-6c23-4054-83d5-079cb648ec8c', '1cda7dbc-ebfd-4343-b10e-7a38c8a48220', '39d45230-6da6-43df-9a01-0ebe9f605692', '1f2ee12e-5d62-4592-9580-782913434478'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:00 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Delete snapshot completed successfully. Jul 09 03:27:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-de6ad787-f649-4dbd-a229-dedfb3d3ad77 tempest-ProjectMemberTests-57018812 None] Lock "cinder-b292dddd-5315-48a4-bd51-ff384120a62e-delete_snapshot" released by "delete_snapshot" :: held 3.263s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:00 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bc666b8-2180-41b7-b85a-75644372bb90 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672" returned: 0 in 0.702s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:00 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 is being set with open permissions: ugo+rw Jul 09 03:27:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:00 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 Jul 09 03:27:00 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-b5342899-a8d5-4d0d-acb3-12295dd39888-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:00 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Lock "cinder-b5342899-a8d5-4d0d-acb3-12295dd39888-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-b5342899-a8d5-4d0d-acb3-12295dd39888" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:01 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-b5342899-a8d5-4d0d-acb3-12295dd39888" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:01 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d962b06c-4f11-4a92-81a1-87ebb4bf7802]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:01 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 Jul 09 03:27:01 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:01 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672" returned: 0 in 0.659s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:01 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.info Jul 09 03:27:01 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:01 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888" returned: 0 in 0.748s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:01 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888 Jul 09 03:27:01 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:01 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.info" returned: 0 in 0.657s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:01 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.info is being set with open permissions: ugo+rw Jul 09 03:27:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:01 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.info Jul 09 03:27:01 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:02 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-b5342899-a8d5-4d0d-acb3-12295dd39888" returned: 0 in 0.646s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:02 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-b5342899-a8d5-4d0d-acb3-12295dd39888" released by "delete_volume" :: held 1.454s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:02 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Created reservations ['e5207c3f-6129-452b-8075-0b29b4c0b628', 'd60b3500-3f60-4789-a67a-f07b8e7fb0d2', 'e60c133d-bd11-4508-a8e7-32cbd181c8f4', 'ae0192a5-7210-4896-b554-5012e4915dbe'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:02 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.info" returned: 0 in 0.666s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:02 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:27:02 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.332s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:02 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2b3fdad2-8b7b-4fda-8d32-58d843c19b2d tempest-ProjectReaderTests-746529896 None] Create snapshot completed successfully Jul 09 03:27:03 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.662s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:27:03 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Deleted volume successfully. Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-1680fad3-66d1-4ba3-bb33-a67ae1d24dfc tempest-ProjectMemberTests-57018812 None] Lock "cinder-b5342899-a8d5-4d0d-acb3-12295dd39888-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-d4cdb18b-74e7-466f-83af-47394eeeb672-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Lock "cinder-d4cdb18b-74e7-466f-83af-47394eeeb672-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-8bc666b8-2180-41b7-b85a-75644372bb90" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-8bc666b8-2180-41b7-b85a-75644372bb90" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-d4cdb18b-74e7-466f-83af-47394eeeb672" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-d4cdb18b-74e7-466f-83af-47394eeeb672" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Deleting offline snapshot d4cdb18b-74e7-466f-83af-47394eeeb672 of volume 8bc666b8-2180-41b7-b85a-75644372bb90 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] snapshot_file for this snap is: volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcbadc2-47ac-43ac-ace3-3f31161aadab]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (440b6729-e7aa-463c-b326-2a5c72aa2f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db15c1a8-c1b7-413d-8ae2-2c87a86ff04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db15c1a8-c1b7-413d-8ae2-2c87a86ff04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339885379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c3f511-c6c0-4d97-8886-8537a7a2c2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:04Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34dc30ed-bce1-443b-b769-7e777e92b5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34dc30ed-bce1-443b-b769-7e777e92b5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8c1b56-626e-42f4-b973-d2526b421703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8c1b56-626e-42f4-b973-d2526b421703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c3f511-c6c0-4d97-8886-8537a7a2c2b9', 'volume_name': 'volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd950edb-4f58-49a8-9bcf-66dd1d4376ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd950edb-4f58-49a8-9bcf-66dd1d4376ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdb9c35-28f5-4b4b-ac18-d4e7adb0afb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:03 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Volume 37c3f511-c6c0-4d97-8886-8537a7a2c2b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9', 'volume_size': 1} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339885379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c3f511-c6c0-4d97-8886-8537a7a2c2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:04Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Creating volume 37c3f511-c6c0-4d97-8886-8537a7a2c2b9 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:03 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 Jul 09 03:27:03 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:27:03 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:27:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:03 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 1073741824 Jul 09 03:27:03 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:04 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672" returned: 0 in 0.814s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:04 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bc666b8-2180-41b7-b85a-75644372bb90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:27:04 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eadc67-2e1e-4a01-8c78-94e993efc8d0]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:04 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 Jul 09 03:27:04 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:04 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 1073741824" returned: 0 in 0.844s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:04 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 Jul 09 03:27:04 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:05 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90" returned: 0 in 0.789s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:05 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9" returned: 0 in 0.639s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:05 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 Jul 09 03:27:05 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdb9c35-28f5-4b4b-ac18-d4e7adb0afb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4234c1fa-4acf-46eb-af68-078508177174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:05 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Volume volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 (37c3f511-c6c0-4d97-8886-8537a7a2c2b9): created successfully Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4234c1fa-4acf-46eb-af68-078508177174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (440b6729-e7aa-463c-b326-2a5c72aa2f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:05 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-5b63cc6c-d775-4df2-8029-9c1bd70ad36c tempest-ProjectMemberTests-57018812 None] Created volume successfully. Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] Creating offline snapshot 24e0cbba-1bf9-479f-b73f-cb82edd90c22 of volume 37c3f511-c6c0-4d97-8886-8537a7a2c2b9 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdba118-0aae-4b25-b7b0-4caae12e05cf]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:05 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 Jul 09 03:27:05 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:06 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672" returned: 0 in 0.762s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:06 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672 Jul 09 03:27:06 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:06 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9" returned: 0 in 0.744s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:06 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 1G Jul 09 03:27:06 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:06 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90.d4cdb18b-74e7-466f-83af-47394eeeb672" returned: 0 in 0.659s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-d4cdb18b-74e7-466f-83af-47394eeeb672" released by "_delete_snapshot" :: held 3.138s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-8bc666b8-2180-41b7-b85a-75644372bb90" released by "delete_snapshot" :: held 3.162s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:06 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Created reservations ['64f5ccef-5554-44c4-9f51-2eab1db20007', '784b46eb-872a-4d4d-8f6c-2b34012308d9', 'f45dcf53-3df0-471d-9de1-bf98b77b8ba1', '1f49ca02-1b26-4250-a2c8-5a824a7d06e7'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:06 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Delete snapshot completed successfully. Jul 09 03:27:06 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-e72e317c-e43a-4a50-af9b-1d401af9b864 tempest-ProjectReaderTests-746529896 None] Lock "cinder-d4cdb18b-74e7-466f-83af-47394eeeb672-delete_snapshot" released by "delete_snapshot" :: held 3.309s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:07 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 1G" returned: 0 in 0.833s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:07 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 Jul 09 03:27:07 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-8bc666b8-2180-41b7-b85a-75644372bb90-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Lock "cinder-8bc666b8-2180-41b7-b85a-75644372bb90-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-8bc666b8-2180-41b7-b85a-75644372bb90" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-8bc666b8-2180-41b7-b85a-75644372bb90" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:07 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6880a6b3-9698-4f8e-94ec-482792fe6727]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:08 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 Jul 09 03:27:08 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:08 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22" returned: 0 in 0.717s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:08 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 is being set with open permissions: ugo+rw Jul 09 03:27:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:08 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 Jul 09 03:27:08 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:08 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90" returned: 0 in 0.784s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:08 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90 Jul 09 03:27:08 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:08 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22" returned: 0 in 0.658s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:08 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.info Jul 09 03:27:08 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:09 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8bc666b8-2180-41b7-b85a-75644372bb90" returned: 0 in 0.651s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:09 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-8bc666b8-2180-41b7-b85a-75644372bb90" released by "delete_volume" :: held 1.495s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:09 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Created reservations ['7ba55f71-d32a-4594-9520-3ab046e19fcf', '07b47577-ca9f-44e0-b111-3e74916cca1c', '6a6d32ff-788b-440c-be1e-467a4c8ee10e', '1eb0d1da-2d83-418c-aba4-81889ed54676'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:09 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:09 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:27:09 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:09 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.info" returned: 0 in 0.676s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:09 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.info is being set with open permissions: ugo+rw Jul 09 03:27:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:09 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.info Jul 09 03:27:09 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:10 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.678s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:27:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Deleted volume successfully. Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9e971153-3c3a-4a92-8e61-27127b6ed252 tempest-ProjectReaderTests-746529896 None] Lock "cinder-8bc666b8-2180-41b7-b85a-75644372bb90-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:10 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.info" returned: 0 in 0.699s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.414s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bfec9912-f0f7-44ce-b78e-cf6a2a8637d5 tempest-ProjectMemberTests-57018812 None] Create snapshot completed successfully Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Flow 'volume_create_manager' (325eca1f-416d-4fed-954a-a59fe8e80935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a142ffcc-98a5-4567-a3eb-9bcc31a158c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a142ffcc-98a5-4567-a3eb-9bcc31a158c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-140860500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9699755-ec90-43c1-b56f-e96ad4d220b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4bbdabd4d444cb7b1f80239dd8aa661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:10Z,use_quota=True,user_id='c450ec0bc2c843e5b66af81c4dcad170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2bb899-0594-4dba-8081-ff0fa15efd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2bb899-0594-4dba-8081-ff0fa15efd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1da1e7e-8b66-49f5-aaf7-18b4f0194fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1da1e7e-8b66-49f5-aaf7-18b4f0194fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9699755-ec90-43c1-b56f-e96ad4d220b8', 'volume_name': 'volume-a9699755-ec90-43c1-b56f-e96ad4d220b8', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e862f16e-2d21-488b-b07d-da07080d5bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e862f16e-2d21-488b-b07d-da07080d5bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1faf6f4d-703f-4ce2-8267-81b7df58349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:10 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Volume a9699755-ec90-43c1-b56f-e96ad4d220b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9699755-ec90-43c1-b56f-e96ad4d220b8', 'volume_size': 1} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-140860500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9699755-ec90-43c1-b56f-e96ad4d220b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4bbdabd4d444cb7b1f80239dd8aa661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:10Z,use_quota=True,user_id='c450ec0bc2c843e5b66af81c4dcad170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Creating volume a9699755-ec90-43c1-b56f-e96ad4d220b8 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:27:10 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:27:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:10 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 1073741824 Jul 09 03:27:10 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-24e0cbba-1bf9-479f-b73f-cb82edd90c22-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Lock "cinder-24e0cbba-1bf9-479f-b73f-cb82edd90c22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-37c3f511-c6c0-4d97-8886-8537a7a2c2b9" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-37c3f511-c6c0-4d97-8886-8537a7a2c2b9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-24e0cbba-1bf9-479f-b73f-cb82edd90c22" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-24e0cbba-1bf9-479f-b73f-cb82edd90c22" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Deleting offline snapshot 24e0cbba-1bf9-479f-b73f-cb82edd90c22 of volume 37c3f511-c6c0-4d97-8886-8537a7a2c2b9 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] snapshot_file for this snap is: volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16316d5-b5ea-47ff-9fa0-22e15059a86b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:11 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 Jul 09 03:27:11 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:11 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 1073741824" returned: 0 in 0.858s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:11 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 Jul 09 03:27:11 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:11 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22" returned: 0 in 0.782s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:11 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[23680ac5-3da2-4ea4-9a78-681ff16b4b76]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:12 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8" returned: 0 in 0.645s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1faf6f4d-703f-4ce2-8267-81b7df58349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9699755-ec90-43c1-b56f-e96ad4d220b8', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54049033-3f38-4261-9b0e-4e59beccdac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:12 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 Jul 09 03:27:12 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:12 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Volume volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 (a9699755-ec90-43c1-b56f-e96ad4d220b8): created successfully Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54049033-3f38-4261-9b0e-4e59beccdac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Flow 'volume_create_manager' (325eca1f-416d-4fed-954a-a59fe8e80935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:12 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-157872eb-ef5c-4e53-888a-a3275b08b1fa tempest-ProjectReaderTests-746529896 None] Created volume successfully. Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] Creating offline snapshot b1ba53a5-b377-4ac1-a7a3-23714316ac99 of volume a9699755-ec90-43c1-b56f-e96ad4d220b8 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb450bb-16ba-415e-bf49-1182fae422fc]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:12 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9" returned: 0 in 0.786s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:12 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 Jul 09 03:27:12 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:12 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 Jul 09 03:27:12 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:13 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8" returned: 0 in 0.771s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:13 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 1G Jul 09 03:27:13 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:13 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22" returned: 0 in 0.747s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:13 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22 Jul 09 03:27:13 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:27:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:13 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:27:13 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:14 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9.24e0cbba-1bf9-479f-b73f-cb82edd90c22" returned: 0 in 0.659s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-24e0cbba-1bf9-479f-b73f-cb82edd90c22" released by "_delete_snapshot" :: held 3.087s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-37c3f511-c6c0-4d97-8886-8537a7a2c2b9" released by "delete_snapshot" :: held 3.112s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Created reservations ['f201d0c5-4534-4295-b870-682defad10a2', 'e5e0895d-3565-4b9c-8b95-21626b18f337', 'ba5f96d3-e62d-4977-948a-cbd8e4c8a908', 'bc9a4533-c489-431b-8f6b-61b7975f095f'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:14 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Delete snapshot completed successfully. Jul 09 03:27:14 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 1G" returned: 0 in 0.859s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-634f6f4c-c90e-439a-96c9-cac59ee7b8c1 tempest-ProjectMemberTests-57018812 None] Lock "cinder-24e0cbba-1bf9-479f-b73f-cb82edd90c22-delete_snapshot" released by "delete_snapshot" :: held 3.249s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:14 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 Jul 09 03:27:14 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:14 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.656s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:27:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:27:15 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99" returned: 0 in 0.685s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:15 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 is being set with open permissions: ugo+rw Jul 09 03:27:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:15 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 Jul 09 03:27:15 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-37c3f511-c6c0-4d97-8886-8537a7a2c2b9-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Lock "cinder-37c3f511-c6c0-4d97-8886-8537a7a2c2b9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-37c3f511-c6c0-4d97-8886-8537a7a2c2b9" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:15 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-37c3f511-c6c0-4d97-8886-8537a7a2c2b9" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:15 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99223fb-2caf-4e25-aa8a-48862b079985]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:15 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 Jul 09 03:27:15 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:15 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99" returned: 0 in 0.651s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:15 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:15 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.info Jul 09 03:27:15 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:16 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9" returned: 0 in 0.783s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:16 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9 Jul 09 03:27:16 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:16 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.info" returned: 0 in 0.650s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:16 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.info is being set with open permissions: ugo+rw Jul 09 03:27:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:16 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.info Jul 09 03:27:16 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:16 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:16 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-37c3f511-c6c0-4d97-8886-8537a7a2c2b9" returned: 0 in 0.666s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:16 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-37c3f511-c6c0-4d97-8886-8537a7a2c2b9" released by "delete_volume" :: held 1.514s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:16 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Created reservations ['b35915fc-6bef-44c8-92c8-979211db94a8', '6ed4b3a3-80ac-4f2e-ad99-75e12a665bc3', '23f8253c-fbbb-408d-bc38-394d8820ef0b', '5860fe5a-f4b7-4732-b0f1-b581d9349da3'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:17 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.info" returned: 0 in 0.658s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.351s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:17 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8346a1e3-6e63-4cb6-abf9-c449772520af tempest-ProjectReaderTests-746529896 None] Create snapshot completed successfully Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:17 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:27:17 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:17 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.640s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:27:17 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Deleted volume successfully. Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-4dd1ebc3-04e0-477d-963b-862afbeeac26 tempest-ProjectMemberTests-57018812 None] Lock "cinder-37c3f511-c6c0-4d97-8886-8537a7a2c2b9-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-b1ba53a5-b377-4ac1-a7a3-23714316ac99-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Lock "cinder-b1ba53a5-b377-4ac1-a7a3-23714316ac99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-a9699755-ec90-43c1-b56f-e96ad4d220b8" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-a9699755-ec90-43c1-b56f-e96ad4d220b8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-b1ba53a5-b377-4ac1-a7a3-23714316ac99" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:17 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-b1ba53a5-b377-4ac1-a7a3-23714316ac99" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Deleting offline snapshot b1ba53a5-b377-4ac1-a7a3-23714316ac99 of volume a9699755-ec90-43c1-b56f-e96ad4d220b8 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] snapshot_file for this snap is: volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4528864-488c-406f-9756-143993413e08]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (51ba2815-bbf3-43d5-8390-40704d9c0206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738febd5-dc05-424e-bf68-d7616c71f95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738febd5-dc05-424e-bf68-d7616c71f95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734702554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3dcfa3-384c-413f-9136-c3baebe24a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:18Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170bbda6-82e7-4724-adb4-9eba4650f198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170bbda6-82e7-4724-adb4-9eba4650f198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af9d227-4894-4693-a7aa-56ff79f4df44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af9d227-4894-4693-a7aa-56ff79f4df44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c3dcfa3-384c-413f-9136-c3baebe24a17', 'volume_name': 'volume-3c3dcfa3-384c-413f-9136-c3baebe24a17', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79dc1cc-4f16-4e33-9db1-a7717bde96a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79dc1cc-4f16-4e33-9db1-a7717bde96a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94664a48-e628-4ef2-8a30-557b11beca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:18 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Volume 3c3dcfa3-384c-413f-9136-c3baebe24a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c3dcfa3-384c-413f-9136-c3baebe24a17', 'volume_size': 1} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734702554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3dcfa3-384c-413f-9136-c3baebe24a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:18Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Creating volume 3c3dcfa3-384c-413f-9136-c3baebe24a17 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:18 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 Jul 09 03:27:18 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:27:18 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:18 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 1073741824 Jul 09 03:27:18 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:18 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99" returned: 0 in 0.771s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9699755-ec90-43c1-b56f-e96ad4d220b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ec2df1-9e77-45bf-89f9-db22cd37d0c3]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:18 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 Jul 09 03:27:18 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:18 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:18 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 1073741824" returned: 0 in 0.817s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:19 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 Jul 09 03:27:19 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:19 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8" returned: 0 in 0.774s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:19 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 Jul 09 03:27:19 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:19 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17" returned: 0 in 0.670s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=119,cinder:INSERT=42,cinder:UPDATE=147,cinder:DELETE=9 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94664a48-e628-4ef2-8a30-557b11beca03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c3dcfa3-384c-413f-9136-c3baebe24a17', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665d6f78-3076-4d54-8ad4-096887124557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=104,cinder:INSERT=37,cinder:UPDATE=144,cinder:DELETE=15 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:27:19 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Volume volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 (3c3dcfa3-384c-413f-9136-c3baebe24a17): created successfully Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665d6f78-3076-4d54-8ad4-096887124557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:19 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (51ba2815-bbf3-43d5-8390-40704d9c0206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:19 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1ced38c3-fedb-42f1-8c9b-1c28544b617a tempest-ProjectMemberTests-57018812 None] Created volume successfully. Jul 09 03:27:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:20 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] Creating offline snapshot ae384531-d48a-4c8c-9fd3-9b02e7d4107a of volume 3c3dcfa3-384c-413f-9136-c3baebe24a17 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:27:20 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[482cae50-5ec9-44f1-9764-afa90e252727]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:20 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99" returned: 0 in 0.786s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:20 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:20 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99 Jul 09 03:27:20 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:20 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 Jul 09 03:27:20 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:21 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8.b1ba53a5-b377-4ac1-a7a3-23714316ac99" returned: 0 in 0.643s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-b1ba53a5-b377-4ac1-a7a3-23714316ac99" released by "_delete_snapshot" :: held 3.093s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-a9699755-ec90-43c1-b56f-e96ad4d220b8" released by "delete_snapshot" :: held 3.125s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:21 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17" returned: 0 in 0.782s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:21 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a 1G Jul 09 03:27:21 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:21 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Created reservations ['ad1cd92a-1814-4fd0-b791-6a35a879ea77', '99a9970b-71cc-4cc1-9c59-af1b375b3161', '1f567662-a32a-43c7-a542-8804b5d8d2d6', '061ab8ce-b979-4498-9109-a8ed961e4579'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:21 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Delete snapshot completed successfully. Jul 09 03:27:21 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-9f55754b-ea66-4c3a-a648-5bc79b46e887 tempest-ProjectReaderTests-746529896 None] Lock "cinder-b1ba53a5-b377-4ac1-a7a3-23714316ac99-delete_snapshot" released by "delete_snapshot" :: held 3.314s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:21 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a 1G" returned: 0 in 0.794s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:21 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:21 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a Jul 09 03:27:21 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-a9699755-ec90-43c1-b56f-e96ad4d220b8-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Lock "cinder-a9699755-ec90-43c1-b56f-e96ad4d220b8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-a9699755-ec90-43c1-b56f-e96ad4d220b8" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:22 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-a9699755-ec90-43c1-b56f-e96ad4d220b8" acquired by "delete_volume" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:22 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[965e6772-8d6f-4172-a7d2-7ef781417851]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:22 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 Jul 09 03:27:22 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:22 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a" returned: 0 in 0.682s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:22 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a is being set with open permissions: ugo+rw Jul 09 03:27:22 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:22 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a Jul 09 03:27:22 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:23 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8" returned: 0 in 0.754s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:23 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8 Jul 09 03:27:23 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:23 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a" returned: 0 in 0.637s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:23 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.info Jul 09 03:27:23 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:23 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-a9699755-ec90-43c1-b56f-e96ad4d220b8" returned: 0 in 0.666s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-a9699755-ec90-43c1-b56f-e96ad4d220b8" released by "delete_volume" :: held 1.477s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Created reservations ['47fbb7da-912f-4d17-9430-ea4b0c7058d5', 'd751dcb3-14a1-4bcd-9aee-c3f5571c908e', 'cb6e8070-129e-46c9-93a5-6908ab8ae99d', 'd1e43cc6-fb2c-49af-bc42-e3069a7d5548'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:23 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.info" returned: 0 in 0.631s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:23 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.info is being set with open permissions: ugo+rw Jul 09 03:27:23 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:23 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:27:23 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:23 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.info Jul 09 03:27:23 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:24 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.info" returned: 0 in 0.638s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:24 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.256s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.689s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:27:24 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Deleted volume successfully. Jul 09 03:27:24 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-dbb648fe-9caa-4422-af75-88a24f2c4bfd tempest-ProjectMemberTests-57018812 None] Create snapshot completed successfully Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-af8fcf68-e409-4a96-8dc0-64f94e38f375 tempest-ProjectReaderTests-746529896 None] Lock "cinder-a9699755-ec90-43c1-b56f-e96ad4d220b8-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Flow 'volume_create_manager' (8ec78322-747c-4af6-89b1-f91aca96bc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75186b0d-16c5-4a5c-acfb-ee6d404021dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75186b0d-16c5-4a5c-acfb-ee6d404021dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174681507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f972cb7b-df09-4ef0-add0-1affd025e2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4bbdabd4d444cb7b1f80239dd8aa661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:25Z,use_quota=True,user_id='c450ec0bc2c843e5b66af81c4dcad170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00408ae9-dd5c-470e-a14a-4e7faca03c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00408ae9-dd5c-470e-a14a-4e7faca03c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68040344-5847-45ff-a386-bd11d2783ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68040344-5847-45ff-a386-bd11d2783ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f972cb7b-df09-4ef0-add0-1affd025e2a7', 'volume_name': 'volume-f972cb7b-df09-4ef0-add0-1affd025e2a7', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f447feaf-ac3d-433e-92a7-76f54c1d9292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f447feaf-ac3d-433e-92a7-76f54c1d9292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afde169b-e8ae-4430-9910-60f24d2ad4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:24 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Volume f972cb7b-df09-4ef0-add0-1affd025e2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f972cb7b-df09-4ef0-add0-1affd025e2a7', 'volume_size': 1} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174681507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f972cb7b-df09-4ef0-add0-1affd025e2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4bbdabd4d444cb7b1f80239dd8aa661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:25Z,use_quota=True,user_id='c450ec0bc2c843e5b66af81c4dcad170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Creating volume f972cb7b-df09-4ef0-add0-1affd025e2a7 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:27:24 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:27:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:25 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 1073741824 Jul 09 03:27:25 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-ae384531-d48a-4c8c-9fd3-9b02e7d4107a-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Lock "cinder-ae384531-d48a-4c8c-9fd3-9b02e7d4107a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-3c3dcfa3-384c-413f-9136-c3baebe24a17" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-3c3dcfa3-384c-413f-9136-c3baebe24a17" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-ae384531-d48a-4c8c-9fd3-9b02e7d4107a" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-ae384531-d48a-4c8c-9fd3-9b02e7d4107a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Deleting offline snapshot ae384531-d48a-4c8c-9fd3-9b02e7d4107a of volume 3c3dcfa3-384c-413f-9136-c3baebe24a17 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] snapshot_file for this snap is: volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e502d12f-9bf0-4d04-b044-2b9ec3740c8c]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:25 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a Jul 09 03:27:25 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:25 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 1073741824" returned: 0 in 0.834s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:25 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 Jul 09 03:27:25 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:26 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a" returned: 0 in 0.796s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c3dcfa3-384c-413f-9136-c3baebe24a17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:27:26 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e24eea4-1a7c-47e8-a2db-46a98ea9a9f3]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:26 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7" returned: 0 in 0.648s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:26 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:27:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afde169b-e8ae-4430-9910-60f24d2ad4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f972cb7b-df09-4ef0-add0-1affd025e2a7', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd6ff5d-d5bf-4373-8b50-255497fab550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:26 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Volume volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 (f972cb7b-df09-4ef0-add0-1affd025e2a7): created successfully Jul 09 03:27:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd6ff5d-d5bf-4373-8b50-255497fab550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:26 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Flow 'volume_create_manager' (8ec78322-747c-4af6-89b1-f91aca96bc6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:26 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 Jul 09 03:27:26 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:26 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-8116715a-480e-47d5-94ce-ad0a005d7583 tempest-ProjectReaderTests-746529896 None] Created volume successfully. Jul 09 03:27:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:27 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] Creating offline snapshot cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 of volume f972cb7b-df09-4ef0-add0-1affd025e2a7 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:27:27 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd722969-bfba-4097-934b-1e73b108d734]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:27 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17" returned: 0 in 0.789s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:27 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a Jul 09 03:27:27 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:27 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 Jul 09 03:27:27 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:27 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7" returned: 0 in 0.791s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:27 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 1G Jul 09 03:27:27 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:27 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a" returned: 0 in 0.753s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:28 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a Jul 09 03:27:28 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:28 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17.ae384531-d48a-4c8c-9fd3-9b02e7d4107a" returned: 0 in 0.677s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-ae384531-d48a-4c8c-9fd3-9b02e7d4107a" released by "_delete_snapshot" :: held 3.106s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-3c3dcfa3-384c-413f-9136-c3baebe24a17" released by "delete_snapshot" :: held 3.126s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:28 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 1G" returned: 0 in 0.791s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:28 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 Jul 09 03:27:28 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:28 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Created reservations ['095dbfdb-6119-4971-be7f-cefeaa0f60b5', '0bc40063-f0ae-4c68-a107-811bb48ad455', 'a3e86dcd-7e30-409c-8187-ee59b5ee6c35', '80e8a3c0-1b25-48f3-a7c0-2097f9a1be22'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:28 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Delete snapshot completed successfully. Jul 09 03:27:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-360c415d-6e0b-44cd-9daa-d41f02c9b087 tempest-ProjectMemberTests-57018812 None] Lock "cinder-ae384531-d48a-4c8c-9fd3-9b02e7d4107a-delete_snapshot" released by "delete_snapshot" :: held 3.276s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:29 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5" returned: 0 in 0.700s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:29 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 is being set with open permissions: ugo+rw Jul 09 03:27:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:29 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 Jul 09 03:27:29 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-3c3dcfa3-384c-413f-9136-c3baebe24a17-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Lock "cinder-3c3dcfa3-384c-413f-9136-c3baebe24a17-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-3c3dcfa3-384c-413f-9136-c3baebe24a17" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:29 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-3c3dcfa3-384c-413f-9136-c3baebe24a17" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:29 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c0c8b-a536-4373-b83b-baecdec87a76]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:29 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 Jul 09 03:27:29 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:30 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5" returned: 0 in 0.656s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:30 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.info Jul 09 03:27:30 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:30 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17" returned: 0 in 0.772s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:30 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17 Jul 09 03:27:30 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:30 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.info" returned: 0 in 0.666s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:30 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.info is being set with open permissions: ugo+rw Jul 09 03:27:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:30 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.info Jul 09 03:27:30 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:31 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-3c3dcfa3-384c-413f-9136-c3baebe24a17" returned: 0 in 0.660s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-3c3dcfa3-384c-413f-9136-c3baebe24a17" released by "delete_volume" :: held 1.487s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:31 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Created reservations ['57c5f099-47bb-4646-928d-d96c1f3f4531', '941953c1-6bb1-46bc-81d4-1b033ea98ed2', '52038fc2-9fe4-472f-83ec-a3e0bc3475e5', '935aabc7-f346-4043-92c4-08c9d7c66e60'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:31 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:31 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.info" returned: 0 in 0.681s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:31 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:27:31 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.368s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:31 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-dc16d7df-2c71-4d2c-a024-9ea4d9359e44 tempest-ProjectReaderTests-746529896 None] Create snapshot completed successfully Jul 09 03:27:32 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.661s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:27:32 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Deleted volume successfully. Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-db8377d6-6eb7-405f-a36e-bcbebfa4ca89 tempest-ProjectMemberTests-57018812 None] Lock "cinder-3c3dcfa3-384c-413f-9136-c3baebe24a17-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Lock "cinder-cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-f972cb7b-df09-4ef0-add0-1affd025e2a7" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-f972cb7b-df09-4ef0-add0-1affd025e2a7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (fd7d7ca3-fbf4-4cf2-be12-d990d48f9701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42d41fa-1cae-4474-9251-d6ce67b59d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Deleting offline snapshot cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 of volume f972cb7b-df09-4ef0-add0-1affd025e2a7 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] snapshot_file for this snap is: volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a530fa7-f63a-4db1-8066-17f6172dd64e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42d41fa-1cae-4474-9251-d6ce67b59d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1422666926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:32Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceab2d4b-a634-4944-b9fb-18c069818bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceab2d4b-a634-4944-b9fb-18c069818bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09634fb6-86c5-418a-a9f9-b3b19e2700a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09634fb6-86c5-418a-a9f9-b3b19e2700a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b', 'volume_name': 'volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adf7f81-4017-4cc3-b20d-79a4ab8a4a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adf7f81-4017-4cc3-b20d-79a4ab8a4a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c25561-8306-49b8-bdc3-b5304b7c9a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:32 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Volume 8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b', 'volume_size': 1} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1422666926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:32Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Creating volume 8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:27:32 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:27:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:32 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b 1073741824 Jul 09 03:27:32 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:32 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 Jul 09 03:27:32 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:33 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5" returned: 0 in 0.762s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f972cb7b-df09-4ef0-add0-1affd025e2a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:27:33 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5513d4a-357a-4a21-ac8a-f5112f40dc03]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:33 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b 1073741824" returned: 0 in 0.830s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:33 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 Jul 09 03:27:33 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:33 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b Jul 09 03:27:33 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:34 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7" returned: 0 in 0.776s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:34 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:34 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 Jul 09 03:27:34 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b" returned: 0 in 0.669s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c25561-8306-49b8-bdc3-b5304b7c9a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91534756-af04-40ae-9ee7-482e3e4f2dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:34 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Volume volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b (8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b): created successfully Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91534756-af04-40ae-9ee7-482e3e4f2dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (fd7d7ca3-fbf4-4cf2-be12-d990d48f9701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:34 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1f99c42a-3c64-40cb-a01b-a09ee92c22b7 tempest-ProjectMemberTests-57018812 None] Created volume successfully. Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] Creating offline snapshot bd0b17d1-9ceb-4884-bf22-3531a9673016 of volume 8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4937895d-2886-46cf-a11c-7b9573be23d9]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:34 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b Jul 09 03:27:34 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:34 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5" returned: 0 in 0.746s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:34 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5 Jul 09 03:27:34 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:35 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b" returned: 0 in 0.776s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:35 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 1G Jul 09 03:27:35 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:35 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7.cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5" returned: 0 in 0.685s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5" released by "_delete_snapshot" :: held 3.054s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-f972cb7b-df09-4ef0-add0-1affd025e2a7" released by "delete_snapshot" :: held 3.110s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:35 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Created reservations ['ff090bf7-3c41-4432-ac6f-5b25dc690e52', 'c5e447bf-afac-4af2-91d3-66455d1995f6', 'fd9384f2-afac-4ff7-8f01-4938cf51c333', 'e7a70b3a-71d7-4e4c-b895-fbc761fe6b9d'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:35 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Delete snapshot completed successfully. Jul 09 03:27:35 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-d556cfcd-27e5-4bea-bae3-80d1e6ecc923 tempest-ProjectReaderTests-746529896 None] Lock "cinder-cd0cab7b-26c2-4af2-9884-fa8dcfc5e3d5-delete_snapshot" released by "delete_snapshot" :: held 3.255s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:36 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 1G" returned: 0 in 0.788s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:36 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 Jul 09 03:27:36 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-f972cb7b-df09-4ef0-add0-1affd025e2a7-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Lock "cinder-f972cb7b-df09-4ef0-add0-1affd025e2a7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Acquiring lock "cinder-quobyte-f972cb7b-df09-4ef0-add0-1affd025e2a7" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-f972cb7b-df09-4ef0-add0-1affd025e2a7" acquired by "delete_volume" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:36 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a802e63c-3261-467b-91aa-3112ec81696d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:36 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 Jul 09 03:27:36 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:36 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016" returned: 0 in 0.693s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:36 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 is being set with open permissions: ugo+rw Jul 09 03:27:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:36 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 Jul 09 03:27:36 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:37 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7" returned: 0 in 0.764s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:37 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7 Jul 09 03:27:37 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:37 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016" returned: 0 in 0.637s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:37 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.info Jul 09 03:27:37 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:38 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-f972cb7b-df09-4ef0-add0-1affd025e2a7" returned: 0 in 0.667s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Lock "cinder-quobyte-f972cb7b-df09-4ef0-add0-1affd025e2a7" released by "delete_volume" :: held 1.503s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Created reservations ['971c8347-df45-4c52-9a3a-7f870a9cc89b', '32fb4d70-0ba9-45b4-b1dc-315e4ef143ad', '29ec7713-52cf-49d2-ad43-64fd52a790b2', 'dea64d47-0e73-417b-9dae-799b78c258e8'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:38 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.info" returned: 0 in 0.665s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:38 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.info is being set with open permissions: ugo+rw Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:38 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.info Jul 09 03:27:38 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:38 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:27:38 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:38 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.info" returned: 0 in 0.673s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.323s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:38 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.662s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:38 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:27:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Deleted volume successfully. Jul 09 03:27:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-779c8ad1-044e-4a05-a9ee-221a498b57ba tempest-ProjectReaderTests-746529896 None] Lock "cinder-f972cb7b-df09-4ef0-add0-1affd025e2a7-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:39 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-bffcb03d-2f5b-469a-9827-ac596df8f303 tempest-ProjectMemberTests-57018812 None] Create snapshot completed successfully Jul 09 03:27:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-bd0b17d1-9ceb-4884-bf22-3531a9673016-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Lock "cinder-bd0b17d1-9ceb-4884-bf22-3531a9673016-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-bd0b17d1-9ceb-4884-bf22-3531a9673016" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:39 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-bd0b17d1-9ceb-4884-bf22-3531a9673016" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Deleting offline snapshot bd0b17d1-9ceb-4884-bf22-3531a9673016 of volume 8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:27:39 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] snapshot_file for this snap is: volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:27:39 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd73b13-33ae-4363-bfa4-e34b5418a4cd]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:40 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 Jul 09 03:27:40 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:40 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016" returned: 0 in 0.778s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:27:40 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7643c2-857d-4aac-a766-fbfe6dc6e496]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:40 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b Jul 09 03:27:40 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:41 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b" returned: 0 in 0.803s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:41 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 Jul 09 03:27:41 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:42 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016" returned: 0 in 0.738s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:42 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016 Jul 09 03:27:42 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:42 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:43 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b.bd0b17d1-9ceb-4884-bf22-3531a9673016" returned: 0 in 0.665s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-bd0b17d1-9ceb-4884-bf22-3531a9673016" released by "_delete_snapshot" :: held 3.083s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b" released by "delete_snapshot" :: held 3.115s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:43 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Created reservations ['66bbe4a9-a4cf-443d-99b7-9cdfee8648f6', '3e4370f9-8c8c-4007-b315-e22170396a9f', 'bb5d4b7e-2668-45fe-b28e-86e8446b47b8', '1de3f6cc-ce3c-458c-a235-7b0f2ee81dd2'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Delete snapshot completed successfully. Jul 09 03:27:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf954ff0-e4ee-44ad-89b5-63fe5540da86 tempest-ProjectMemberTests-57018812 None] Lock "cinder-bd0b17d1-9ceb-4884-bf22-3531a9673016-delete_snapshot" released by "delete_snapshot" :: held 3.283s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Lock "cinder-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:44 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:44 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e17d31-eb55-4739-b141-9457c5308776]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:44 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:44 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b Jul 09 03:27:44 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:45 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b" returned: 0 in 0.763s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:45 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b Jul 09 03:27:45 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:45 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b" returned: 0 in 0.652s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:45 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b" released by "delete_volume" :: held 1.478s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:45 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Created reservations ['93cb6df9-513a-4ad3-9ef0-9aa41f1c76a6', '8c245da9-7f8b-4590-a709-11b06cf7610d', 'e4b6df31-c84f-457c-a3bf-60803639b06a', 'ef9dc610-b558-46f9-867f-b062ad415bff'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:45 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:45 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:45 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:27:45 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:46 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.659s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:27:46 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Deleted volume successfully. Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cf429311-edcf-4980-ae9e-9a918f02e04f tempest-ProjectMemberTests-57018812 None] Lock "cinder-8f7f96f6-34a6-49bf-8dcf-0ba38d98a10b-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (b8a51f14-8ab6-435e-bc6a-705294b709fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab1ec77-04af-415b-b68c-abfd4f35f4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab1ec77-04af-415b-b68c-abfd4f35f4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465012577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715048c1-84bd-4e2a-879e-cc8799846fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:47Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0647b1e3-2f18-4932-8942-7e94ef6be661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0647b1e3-2f18-4932-8942-7e94ef6be661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9aef12-018b-429b-aed4-2dbff43e0ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9aef12-018b-429b-aed4-2dbff43e0ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '715048c1-84bd-4e2a-879e-cc8799846fc8', 'volume_name': 'volume-715048c1-84bd-4e2a-879e-cc8799846fc8', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79f0e63-e6c4-4228-ba43-f3aeafcb3250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79f0e63-e6c4-4228-ba43-f3aeafcb3250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa82809a-7a57-40b6-a2b9-a3822b5586b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:46 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Volume 715048c1-84bd-4e2a-879e-cc8799846fc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-715048c1-84bd-4e2a-879e-cc8799846fc8', 'volume_size': 1} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465012577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715048c1-84bd-4e2a-879e-cc8799846fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:27:47Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Creating volume 715048c1-84bd-4e2a-879e-cc8799846fc8 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:27:46 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:27:46 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:47 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 1073741824 Jul 09 03:27:47 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:47 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 1073741824" returned: 0 in 0.915s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:47 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:47 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 Jul 09 03:27:47 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:48 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8" returned: 0 in 0.655s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:48 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:27:48 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa82809a-7a57-40b6-a2b9-a3822b5586b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-715048c1-84bd-4e2a-879e-cc8799846fc8', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f176cf-fc62-4c99-8a9f-8a23a500f00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:27:48 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Volume volume-715048c1-84bd-4e2a-879e-cc8799846fc8 (715048c1-84bd-4e2a-879e-cc8799846fc8): created successfully Jul 09 03:27:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f176cf-fc62-4c99-8a9f-8a23a500f00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:27:48 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (b8a51f14-8ab6-435e-bc6a-705294b709fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:27:48 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-e6b0cba3-6b78-4516-be09-2867f067f7db tempest-ProjectMemberTests-57018812 None] Created volume successfully. Jul 09 03:27:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:49 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] Creating offline snapshot f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 of volume 715048c1-84bd-4e2a-879e-cc8799846fc8 {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:27:49 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfb1f6d-e805-4f7f-b30f-4fbae619a813]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:49 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 Jul 09 03:27:49 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:49 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8" returned: 0 in 0.732s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:49 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:49 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 1G Jul 09 03:27:49 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:50 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 1G" returned: 0 in 0.767s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:50 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715048c1-84bd-4e2a-879e-cc8799846fc8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:50 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715048c1-84bd-4e2a-879e-cc8799846fc8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 Jul 09 03:27:50 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:51 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715048c1-84bd-4e2a-879e-cc8799846fc8 -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5" returned: 0 in 0.695s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:51 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 is being set with open permissions: ugo+rw Jul 09 03:27:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:51 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 Jul 09 03:27:51 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:51 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:51 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5" returned: 0 in 0.629s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:52 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.info Jul 09 03:27:52 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:52 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.info" returned: 0 in 0.655s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:52 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.info is being set with open permissions: ugo+rw Jul 09 03:27:52 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:52 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.info Jul 09 03:27:52 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:53 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.info" returned: 0 in 0.648s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:53 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:53 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-feefbb76-6bc1-40a9-8678-c83803e1e1ff tempest-ProjectMemberTests-57018812 None] Create snapshot completed successfully Jul 09 03:27:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-f1b1c41e-dbfa-49f5-92fe-407d6382d7b5-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Lock "cinder-f1b1c41e-dbfa-49f5-92fe-407d6382d7b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-715048c1-84bd-4e2a-879e-cc8799846fc8" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-715048c1-84bd-4e2a-879e-cc8799846fc8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-f1b1c41e-dbfa-49f5-92fe-407d6382d7b5" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:54 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-f1b1c41e-dbfa-49f5-92fe-407d6382d7b5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Deleting offline snapshot f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 of volume 715048c1-84bd-4e2a-879e-cc8799846fc8 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:27:54 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] snapshot_file for this snap is: volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:27:54 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f947878b-fbb2-46a1-bc6c-b261a4fffa28]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:54 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:54 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 Jul 09 03:27:54 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:55 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5" returned: 0 in 0.764s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:55 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-715048c1-84bd-4e2a-879e-cc8799846fc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:27:55 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[313f974f-ebb7-484d-90e0-e4980fb0d70a]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:55 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 Jul 09 03:27:55 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:55 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8" returned: 0 in 0.746s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:55 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:55 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 Jul 09 03:27:55 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:56 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5" returned: 0 in 0.738s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:56 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:56 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5 Jul 09 03:27:56 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:57 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8.f1b1c41e-dbfa-49f5-92fe-407d6382d7b5" returned: 0 in 0.638s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-f1b1c41e-dbfa-49f5-92fe-407d6382d7b5" released by "_delete_snapshot" :: held 2.967s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-715048c1-84bd-4e2a-879e-cc8799846fc8" released by "delete_snapshot" :: held 2.988s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:57 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Created reservations ['00479335-bb41-4f0c-a04d-9e86006cbdca', 'f8703b3d-01b4-456f-a76b-e800a801c199', 'c57d0396-2718-4c2c-9198-e03a7ae7c73c', '4cb9bb8b-183f-4b2d-9404-e488adeab1c4'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:57 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Delete snapshot completed successfully. Jul 09 03:27:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-658e295e-40f0-4f60-80e0-6c39604549b0 tempest-ProjectMemberTests-57018812 None] Lock "cinder-f1b1c41e-dbfa-49f5-92fe-407d6382d7b5-delete_snapshot" released by "delete_snapshot" :: held 3.116s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-715048c1-84bd-4e2a-879e-cc8799846fc8-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Lock "cinder-715048c1-84bd-4e2a-879e-cc8799846fc8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-715048c1-84bd-4e2a-879e-cc8799846fc8" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:27:57 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-715048c1-84bd-4e2a-879e-cc8799846fc8" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:27:57 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47741b64-cc44-4843-bdf3-152b418acbdf]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:27:57 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:57 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 Jul 09 03:27:57 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:58 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8" returned: 0 in 0.754s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:58 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:58 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8 Jul 09 03:27:58 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:59 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-715048c1-84bd-4e2a-879e-cc8799846fc8" returned: 0 in 0.634s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-715048c1-84bd-4e2a-879e-cc8799846fc8" released by "delete_volume" :: held 1.451s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Created reservations ['83be4568-0646-43aa-81b1-b3568fbb65ca', 'd90245ce-131e-4e6d-a761-a530a39963a8', 'f3dea18e-9216-4294-a21c-9eb5c16bfc15', 'ec623c38-ea2c-41b7-8017-398a7be61d11'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:27:59 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:27:59 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:27:59 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.628s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:27:59 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Deleted volume successfully. Jul 09 03:27:59 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f8fbfb6c-1014-4d0e-849e-51c0486f8b0e tempest-ProjectMemberTests-57018812 None] Lock "cinder-715048c1-84bd-4e2a-879e-cc8799846fc8-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (d590536b-1313-48a1-a617-7b20a3e8bd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d8172a-f5be-4e1e-b8a3-8dc626c6cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d8172a-f5be-4e1e-b8a3-8dc626c6cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-14184102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe0670a-008e-444d-831d-44295c4412fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:28:00Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72081f6-667c-4411-997d-d5158807c7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72081f6-667c-4411-997d-d5158807c7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4b6bf0-4f1d-4143-a435-be2fc39d106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4b6bf0-4f1d-4143-a435-be2fc39d106c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe0670a-008e-444d-831d-44295c4412fb', 'volume_name': 'volume-abe0670a-008e-444d-831d-44295c4412fb', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402c5a8c-60eb-4e10-b0a0-8f8cff49c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402c5a8c-60eb-4e10-b0a0-8f8cff49c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02a4ce4-a368-4185-a8fa-ecf291ba6a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:00 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Volume abe0670a-008e-444d-831d-44295c4412fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe0670a-008e-444d-831d-44295c4412fb', 'volume_size': 1} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-14184102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe0670a-008e-444d-831d-44295c4412fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f523c78115a43b0875b8c082ff32848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:28:00Z,use_quota=True,user_id='8c17484dbe1c4dc28630903f51b49ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Creating volume abe0670a-008e-444d-831d-44295c4412fb {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:28:00 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:28:00 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:00 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb 1073741824 Jul 09 03:28:00 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:01 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb 1073741824" returned: 0 in 0.791s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:01 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb Jul 09 03:28:01 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:01 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb" returned: 0 in 0.618s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:01 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:28:01 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02a4ce4-a368-4185-a8fa-ecf291ba6a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe0670a-008e-444d-831d-44295c4412fb', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f910c87e-9383-4aa9-b358-36494387d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:01 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Volume volume-abe0670a-008e-444d-831d-44295c4412fb (abe0670a-008e-444d-831d-44295c4412fb): created successfully Jul 09 03:28:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f910c87e-9383-4aa9-b358-36494387d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:01 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Flow 'volume_create_manager' (d590536b-1313-48a1-a617-7b20a3e8bd93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:28:01 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f912f90e-bae0-459c-a74f-0d93aaf77689 tempest-ProjectMemberTests-57018812 None] Created volume successfully. Jul 09 03:28:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:02 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] Creating offline snapshot f863f62a-a908-4f95-8375-ab2de2b6fe3f of volume abe0670a-008e-444d-831d-44295c4412fb {{(pid=87216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:28:02 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1481a6b8-9ce7-4126-958a-3d108af18053]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:28:02 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:02 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb Jul 09 03:28:02 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:03 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb" returned: 0 in 0.754s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f 1G {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:03 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f 1G Jul 09 03:28:03 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:03 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f 1G" returned: 0 in 0.775s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:03 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe0670a-008e-444d-831d-44295c4412fb -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:03 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe0670a-008e-444d-831d-44295c4412fb -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f Jul 09 03:28:03 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:04 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe0670a-008e-444d-831d-44295c4412fb -F qcow2 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f" returned: 0 in 0.680s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:04 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f is being set with open permissions: ugo+rw Jul 09 03:28:04 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:04 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f Jul 09 03:28:04 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:05 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f" returned: 0 in 0.650s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:05 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.info Jul 09 03:28:05 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:05 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.info" returned: 0 in 0.628s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:05 devstack cinder-volume[87216]: WARNING cinder.volume.drivers.remotefs [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.info is being set with open permissions: ugo+rw Jul 09 03:28:05 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.info {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:05 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.info Jul 09 03:28:05 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:06 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.info" returned: 0 in 0.653s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:06 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.214s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:06 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-a82e279f-bd76-4d49-b3c8-5e5721004a3a tempest-ProjectMemberTests-57018812 None] Create snapshot completed successfully Jul 09 03:28:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-f863f62a-a908-4f95-8375-ab2de2b6fe3f-delete_snapshot" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Lock "cinder-f863f62a-a908-4f95-8375-ab2de2b6fe3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-abe0670a-008e-444d-831d-44295c4412fb" by "delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-abe0670a-008e-444d-831d-44295c4412fb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-f863f62a-a908-4f95-8375-ab2de2b6fe3f" by "_delete_snapshot" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:07 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-f863f62a-a908-4f95-8375-ab2de2b6fe3f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Deleting offline snapshot f863f62a-a908-4f95-8375-ab2de2b6fe3f of volume abe0670a-008e-444d-831d-44295c4412fb {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:28:07 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] snapshot_file for this snap is: volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f {{(pid=87216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:28:07 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b462ce78-1a67-4ef2-9bf4-8f82a881fc58]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:28:07 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:07 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f Jul 09 03:28:07 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:08 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f" returned: 0 in 0.734s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:08 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abe0670a-008e-444d-831d-44295c4412fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:28:08 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdf5dff-88d2-4533-b76d-d9ea5264aeae]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:28:08 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:08 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb Jul 09 03:28:08 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:09 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb" returned: 0 in 0.752s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:09 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f Jul 09 03:28:09 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:09 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f" returned: 0 in 0.728s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:09 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:10 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f Jul 09 03:28:10 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:10 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb.f863f62a-a908-4f95-8375-ab2de2b6fe3f" returned: 0 in 0.652s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-f863f62a-a908-4f95-8375-ab2de2b6fe3f" released by "_delete_snapshot" :: held 2.962s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-abe0670a-008e-444d-831d-44295c4412fb" released by "delete_snapshot" :: held 2.984s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:10 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Created reservations ['106462b8-bb8c-4b79-9c10-d153ce365929', '8a7bf522-f986-4c48-abda-e65c1c5b24ba', '758f5884-f33c-4bee-b839-767458775f10', '2a60f51a-d95f-4da6-9c0f-e8607a2c2ef2'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:28:10 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Delete snapshot completed successfully. Jul 09 03:28:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-cafddd37-2b67-4398-9a9c-736e12d7a6e9 tempest-ProjectMemberTests-57018812 None] Lock "cinder-f863f62a-a908-4f95-8375-ab2de2b6fe3f-delete_snapshot" released by "delete_snapshot" :: held 3.119s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-abe0670a-008e-444d-831d-44295c4412fb-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Lock "cinder-abe0670a-008e-444d-831d-44295c4412fb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Acquiring lock "cinder-quobyte-abe0670a-008e-444d-831d-44295c4412fb" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:10 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-abe0670a-008e-444d-831d-44295c4412fb" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:10 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fd17d8-fef6-4cc4-99cb-ef1f1253cb1b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:28:10 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:11 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb Jul 09 03:28:11 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:11 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb" returned: 0 in 0.748s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:11 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:11 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb Jul 09 03:28:11 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:12 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-abe0670a-008e-444d-831d-44295c4412fb" returned: 0 in 0.652s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:12 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Lock "cinder-quobyte-abe0670a-008e-444d-831d-44295c4412fb" released by "delete_volume" :: held 1.459s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:12 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Created reservations ['4dd3dba4-c444-4a0e-bb61-a40bacb3d130', 'fdbdbcfe-ea64-423e-9eda-4dc512123f31', '0ac42ac3-731f-45e9-82da-2a0b54329a4a', '0f377ddf-7fa8-4cec-ad54-9af0b4e99b6a'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:28:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:28:12 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:28:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:12 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:12 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:28:12 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:13 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.663s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:13 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:28:13 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Deleted volume successfully. Jul 09 03:28:13 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-63c03d1a-a2c6-4d45-adca-055a12b578f1 tempest-ProjectMemberTests-57018812 None] Lock "cinder-abe0670a-008e-444d-831d-44295c4412fb-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:13 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:28:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:28:13 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:28:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:13 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:13 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:28:13 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:14 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:14 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.702s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:14 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:28:14 devstack cinder-volume[87216]: DEBUG oslo_service.periodic_task [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87216) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:28:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread count: 28 {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:28:14 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-86ec0cac-15f1-4bea-8e83-f2deea0fa2e5 None None] thread info: [<_MainThread(MainThread, started 139156079677568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87216) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:28:22 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:DELETE=10,cinder:UPDATE=98,cinder:SELECT=78,cinder:INSERT=26 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:28:23 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:UPDATE=104,cinder:SELECT=77,cinder:INSERT=31,cinder:DELETE=6 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Flow 'volume_create_manager' (e9972e0f-15f4-49c1-b961-261c2572295b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f18a02e-5c7d-4f7d-ad42-7b9e5221565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f18a02e-5c7d-4f7d-ad42-7b9e5221565b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-309983291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096ea918-6954-4be5-8978-5301f8c382e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a7cb378f644b59fb04d50106a6365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:28:24Z,use_quota=True,user_id='5f706b2e9a5f4f01b90f03639e77f1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1ef9e2-1af5-4515-bff1-301727d3105b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1ef9e2-1af5-4515-bff1-301727d3105b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b73b1a-4659-4261-8b10-eaf49c94f851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b73b1a-4659-4261-8b10-eaf49c94f851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '096ea918-6954-4be5-8978-5301f8c382e2', 'volume_name': 'volume-096ea918-6954-4be5-8978-5301f8c382e2', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4c3231-dab2-4bee-9dc2-e3086320630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4c3231-dab2-4bee-9dc2-e3086320630b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac348563-dea5-4584-9694-786316405cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:24 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Volume 096ea918-6954-4be5-8978-5301f8c382e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-096ea918-6954-4be5-8978-5301f8c382e2', 'volume_size': 1} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-309983291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096ea918-6954-4be5-8978-5301f8c382e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a7cb378f644b59fb04d50106a6365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:28:24Z,use_quota=True,user_id='5f706b2e9a5f4f01b90f03639e77f1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Creating volume 096ea918-6954-4be5-8978-5301f8c382e2 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:28:24 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:28:24 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:24 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2 1073741824 Jul 09 03:28:24 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:25 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2 1073741824" returned: 0 in 0.832s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:25 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2 Jul 09 03:28:25 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:25 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2" returned: 0 in 0.641s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:25 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:28:25 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac348563-dea5-4584-9694-786316405cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-096ea918-6954-4be5-8978-5301f8c382e2', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bfff92-a2ef-4fae-813f-20b93502bcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:25 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Volume volume-096ea918-6954-4be5-8978-5301f8c382e2 (096ea918-6954-4be5-8978-5301f8c382e2): created successfully Jul 09 03:28:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bfff92-a2ef-4fae-813f-20b93502bcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:25 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Flow 'volume_create_manager' (e9972e0f-15f4-49c1-b961-261c2572295b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:28:25 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-1959b2fc-5ccc-4e4c-bc6c-ae37701a9de6 tempest-ProjectReaderTests-1606523426 None] Created volume successfully. Jul 09 03:28:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "cinder-096ea918-6954-4be5-8978-5301f8c382e2-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Lock "cinder-096ea918-6954-4be5-8978-5301f8c382e2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "cinder-quobyte-096ea918-6954-4be5-8978-5301f8c382e2" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:26 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Lock "cinder-quobyte-096ea918-6954-4be5-8978-5301f8c382e2" acquired by "delete_volume" :: waited 0.019s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:26 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b59473-0acb-40e2-8a9a-b1a866a1fe8d]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:28:26 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:26 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2 Jul 09 03:28:26 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:27 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2" returned: 0 in 0.765s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:27 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2 Jul 09 03:28:27 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:27 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:27 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-096ea918-6954-4be5-8978-5301f8c382e2" returned: 0 in 0.641s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Lock "cinder-quobyte-096ea918-6954-4be5-8978-5301f8c382e2" released by "delete_volume" :: held 1.442s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:28 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Created reservations ['e3f3ce2b-a6c2-4d5e-8dbf-466ae7180d0b', '169201ab-c0d6-401b-964c-435685923c82', '75c6e64a-7c42-44c8-b497-c56c779abed0', '5b90f01d-69a0-415f-93d1-4af423dd0967'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:28:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:28:28 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:28:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:28 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:28:28 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:28 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:28 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.651s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:28 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:28:28 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Deleted volume successfully. Jul 09 03:28:28 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-c769306c-ee3f-41e2-afb6-a02a33ed82e7 tempest-ProjectReaderTests-1606523426 None] Lock "cinder-096ea918-6954-4be5-8978-5301f8c382e2-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Flow 'volume_create_manager' (c815d5ef-27e5-44b2-96a7-5453bf40ed92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94b1284-3961-4d56-9a2a-1699f8e0ea71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94b1284-3961-4d56-9a2a-1699f8e0ea71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130872140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3f2bc7-89ef-4ec8-89bf-2c29317a5518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a7cb378f644b59fb04d50106a6365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:28:29Z,use_quota=True,user_id='5f706b2e9a5f4f01b90f03639e77f1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77715b7e-62fc-493c-8a56-bda1c15f4d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77715b7e-62fc-493c-8a56-bda1c15f4d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f7038d-29d5-4214-bcfe-d53e9167c13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f7038d-29d5-4214-bcfe-d53e9167c13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa3f2bc7-89ef-4ec8-89bf-2c29317a5518', 'volume_name': 'volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2aa645c-a216-4207-ae3e-7770d321e897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2aa645c-a216-4207-ae3e-7770d321e897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31cf1d1-b60b-4473-b7f1-53dc839fdbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:29 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Volume aa3f2bc7-89ef-4ec8-89bf-2c29317a5518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518', 'volume_size': 1} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130872140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3f2bc7-89ef-4ec8-89bf-2c29317a5518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a7cb378f644b59fb04d50106a6365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:28:29Z,use_quota=True,user_id='5f706b2e9a5f4f01b90f03639e77f1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Creating volume aa3f2bc7-89ef-4ec8-89bf-2c29317a5518 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:28:29 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:28:29 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:29 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518 1073741824 Jul 09 03:28:29 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:29 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518 1073741824" returned: 0 in 0.788s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:30 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518 Jul 09 03:28:30 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:30 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518" returned: 0 in 0.647s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:30 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:28:30 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31cf1d1-b60b-4473-b7f1-53dc839fdbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3856a42f-b243-499a-a47d-bba011c7aa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:30 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Volume volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518 (aa3f2bc7-89ef-4ec8-89bf-2c29317a5518): created successfully Jul 09 03:28:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3856a42f-b243-499a-a47d-bba011c7aa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:30 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Flow 'volume_create_manager' (c815d5ef-27e5-44b2-96a7-5453bf40ed92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:28:30 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f0115dff-0179-40bd-8bf8-25a3bc357f5d tempest-ProjectReaderTests-1606523426 None] Created volume successfully. Jul 09 03:28:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Acquiring lock "cinder-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Lock "cinder-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Acquiring lock "cinder-quobyte-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:31 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Lock "cinder-quobyte-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:31 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f406bf-7291-47f1-b2e6-4ec88a796f3e]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:28:31 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:31 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518 Jul 09 03:28:31 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:32 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518" returned: 0 in 0.743s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:32 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518 Jul 09 03:28:32 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:32 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518" returned: 0 in 0.627s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:32 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Lock "cinder-quobyte-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518" released by "delete_volume" :: held 1.409s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:32 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Created reservations ['5c350a2c-9a9d-45a5-87e2-54efbe057081', '3d677429-66ea-4d69-af3c-8d23cd7cea45', 'aceeb3e7-253a-4573-9ea2-378dcca31e7d', '773b80c2-89e8-4881-85ff-dc5e70221baf'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:28:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:28:32 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:28:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:32 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:32 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:28:32 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:33 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.663s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:28:33 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Deleted volume successfully. Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-422e2c19-7526-4472-a355-3a8162caa29c tempest-ProjectReaderTests-1606523426 None] Lock "cinder-aa3f2bc7-89ef-4ec8-89bf-2c29317a5518-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Flow 'volume_create_manager' (e1c7b9c6-cbdb-4b99-9a6b-3cd0f89d2007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be08661-b30d-4a43-9ada-ecdf38db636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be08661-b30d-4a43-9ada-ecdf38db636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983051310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc9cba8-6abb-4846-a45f-82244d975a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a7cb378f644b59fb04d50106a6365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:28:34Z,use_quota=True,user_id='5f706b2e9a5f4f01b90f03639e77f1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1135d31-062e-4fb1-b391-b7cfa0cc96f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1135d31-062e-4fb1-b391-b7cfa0cc96f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fe8f66-1105-4a9c-88e1-85fd0b78ad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fe8f66-1105-4a9c-88e1-85fd0b78ad04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc9cba8-6abb-4846-a45f-82244d975a01', 'volume_name': 'volume-7fc9cba8-6abb-4846-a45f-82244d975a01', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bd083f-0a82-45f1-8945-f0a7d8906455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bd083f-0a82-45f1-8945-f0a7d8906455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1cde91-4744-4dea-9122-434ffeffca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:33 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Volume 7fc9cba8-6abb-4846-a45f-82244d975a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc9cba8-6abb-4846-a45f-82244d975a01', 'volume_size': 1} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983051310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc9cba8-6abb-4846-a45f-82244d975a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a7cb378f644b59fb04d50106a6365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:28:34Z,use_quota=True,user_id='5f706b2e9a5f4f01b90f03639e77f1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Creating volume 7fc9cba8-6abb-4846-a45f-82244d975a01 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:28:33 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:28:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:33 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01 1073741824 Jul 09 03:28:33 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:34 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01 1073741824" returned: 0 in 0.826s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:34 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:34 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01 Jul 09 03:28:34 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:35 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01" returned: 0 in 0.652s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:35 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:28:35 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1cde91-4744-4dea-9122-434ffeffca9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc9cba8-6abb-4846-a45f-82244d975a01', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7300b179-7f43-4ab4-b249-a1627f1c4641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:35 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Volume volume-7fc9cba8-6abb-4846-a45f-82244d975a01 (7fc9cba8-6abb-4846-a45f-82244d975a01): created successfully Jul 09 03:28:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7300b179-7f43-4ab4-b249-a1627f1c4641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Flow 'volume_create_manager' (e1c7b9c6-cbdb-4b99-9a6b-3cd0f89d2007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:28:35 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-6c3d5ca0-6ade-4b80-8a2b-2f0627f22260 tempest-ProjectReaderTests-1606523426 None] Created volume successfully. Jul 09 03:28:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "cinder-7fc9cba8-6abb-4846-a45f-82244d975a01-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Lock "cinder-7fc9cba8-6abb-4846-a45f-82244d975a01-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "cinder-quobyte-7fc9cba8-6abb-4846-a45f-82244d975a01" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:36 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Lock "cinder-quobyte-7fc9cba8-6abb-4846-a45f-82244d975a01" acquired by "delete_volume" :: waited 0.014s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:36 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa67367-7056-4175-baa4-d8cf7a7a070b]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:28:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:36 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01 Jul 09 03:28:36 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:36 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01" returned: 0 in 0.744s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:36 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:36 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01 Jul 09 03:28:36 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:37 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-7fc9cba8-6abb-4846-a45f-82244d975a01" returned: 0 in 0.633s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:37 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Lock "cinder-quobyte-7fc9cba8-6abb-4846-a45f-82244d975a01" released by "delete_volume" :: held 1.415s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:37 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Created reservations ['d1dd6a5e-e513-4c10-bf5d-703a11662d0d', '084bda50-9045-40b2-92ad-671b931cc7c8', '58163e13-be35-447c-a958-e9e25144ce40', '44dd605b-7dc5-4036-9dfc-856f7613c5d1'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:28:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:28:37 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:28:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:37 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:37 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:28:37 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:38 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.626s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:28:38 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Deleted volume successfully. Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-f127377f-0c1f-479e-acdf-4fd04bbb7012 tempest-ProjectReaderTests-1606523426 None] Lock "cinder-7fc9cba8-6abb-4846-a45f-82244d975a01-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Flow 'volume_create_manager' (6ba3303e-92b3-46a6-8c68-093f5d9754ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92a7b1a-1210-4831-96bf-91aa2e4d0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92a7b1a-1210-4831-96bf-91aa2e4d0d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005948045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b0b7c5-6721-4fff-9a24-2dd334895509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a7cb378f644b59fb04d50106a6365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:28:39Z,use_quota=True,user_id='5f706b2e9a5f4f01b90f03639e77f1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebe7618-d854-4c16-a603-f0f11bb34431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebe7618-d854-4c16-a603-f0f11bb34431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e06879f-ae00-4648-99e1-9ae291fee314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e06879f-ae00-4648-99e1-9ae291fee314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5b0b7c5-6721-4fff-9a24-2dd334895509', 'volume_name': 'volume-d5b0b7c5-6721-4fff-9a24-2dd334895509', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c556a8-80e5-42b8-9ca3-4b85944ce679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c556a8-80e5-42b8-9ca3-4b85944ce679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b7a197-5290-46c3-9f9d-4d33eb05c72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:38 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Volume d5b0b7c5-6721-4fff-9a24-2dd334895509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5b0b7c5-6721-4fff-9a24-2dd334895509', 'volume_size': 1} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005948045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b0b7c5-6721-4fff-9a24-2dd334895509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a7cb378f644b59fb04d50106a6365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:28:39Z,use_quota=True,user_id='5f706b2e9a5f4f01b90f03639e77f1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c6dc4e-ec0a-4001-8bea-695957075246),volume_type_id=70c6dc4e-ec0a-4001-8bea-695957075246)}" {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.remotefs [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Creating volume d5b0b7c5-6721-4fff-9a24-2dd334895509 {{(pid=87216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Selected osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b as target Quobyte volume. {{(pid=87216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:28:38 devstack cinder-volume[87216]: INFO cinder.volume.drivers.remotefs [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] casted to osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b Jul 09 03:28:38 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509 1073741824 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:38 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509 1073741824 Jul 09 03:28:38 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:39 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509 1073741824" returned: 0 in 0.792s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:39 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:39 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509 Jul 09 03:28:39 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:40 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509" returned: 0 in 0.646s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'} {{(pid=87216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b7a197-5290-46c3-9f9d-4d33eb05c72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5b0b7c5-6721-4fff-9a24-2dd334895509', 'volume_size': 1}' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d002f0-fe77-4ec8-8d36-2ef849e7096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:28:40 devstack cinder-volume[87216]: INFO cinder.volume.flows.manager.create_volume [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Volume volume-d5b0b7c5-6721-4fff-9a24-2dd334895509 (d5b0b7c5-6721-4fff-9a24-2dd334895509): created successfully Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d002f0-fe77-4ec8-8d36-2ef849e7096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87216) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Flow 'volume_create_manager' (6ba3303e-92b3-46a6-8c68-093f5d9754ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87216) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:28:40 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-c34cb059-7507-4b15-b845-5f182a374df2 tempest-ProjectReaderTests-1606523426 None] Created volume successfully. Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Acquiring lock "cinder-d5b0b7c5-6721-4fff-9a24-2dd334895509-delete_volume" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Lock "cinder-d5b0b7c5-6721-4fff-9a24-2dd334895509-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Acquiring lock "cinder-quobyte-d5b0b7c5-6721-4fff-9a24-2dd334895509" by "delete_volume" {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Lock "cinder-quobyte-d5b0b7c5-6721-4fff-9a24-2dd334895509" acquired by "delete_volume" :: waited 0.015s {{(pid=87216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG oslo.privsep.daemon [-] privsep: reply[16545ff3-7f3e-427f-a937-e5a17d9b1b68]: (4, 'qcow2') {{(pid=88178) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:28:40 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:40 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509 Jul 09 03:28:40 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:41 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509" returned: 0 in 0.757s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:41 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:41 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509 Jul 09 03:28:41 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:42 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798/volume-d5b0b7c5-6721-4fff-9a24-2dd334895509" returned: 0 in 0.658s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:42 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Lock "cinder-quobyte-d5b0b7c5-6721-4fff-9a24-2dd334895509" released by "delete_volume" :: held 1.452s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:28:42 devstack cinder-volume[87216]: DEBUG cinder.quota [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Created reservations ['ebfbdf40-59ea-43c1-9e76-ec46233b8886', '1d11d247-bbd2-45ff-b486-45d5cd56afe9', '69711980-1b40-4c6b-8ca5-d9d3990d89f6', '61583747-b2ce-4cd6-a0d6-57921ddebc4e'] {{(pid=87216) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:28:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:28:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:28:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b': None} {{(pid=87216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:28:42 devstack cinder-volume[87216]: DEBUG cinder.volume.drivers.quobyte [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96fe93f1-4a5a-4884-b351-47a10940ca3b'] {{(pid=87216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:28:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87216) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:28:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:28:42 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798 Jul 09 03:28:42 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:28:42 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 09 03:28:42 devstack cinder-volume[87216]: DEBUG oslo_concurrency.processutils [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c563d46a920d054a01658200e3c2c798" returned: 0 in 0.648s {{(pid=87216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:28:42 devstack cinder-volume[87216]: DEBUG cinder.manager [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Notifying Schedulers of capabilities ... {{(pid=87216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:28:43 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Deleted volume successfully. Jul 09 03:28:43 devstack cinder-volume[87216]: DEBUG cinder.coordination [None req-2dfde0d6-7d89-4db3-9960-33ca2f7def0d tempest-ProjectReaderTests-1606523426 None] Lock "cinder-d5b0b7c5-6721-4fff-9a24-2dd334895509-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=87216) __release /opt/stack/cinder/cinder/coordination.py:152}}